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Abstract 


The  FLEX  system  consists  oi  merged  "hardware"  and 
"software"  that  is  optimized  towards  handling  algorithmic 
operations  in  an  interactive,  man-machine  dialog. 

The  basic  form  is  that  of  a  hardware  implementation 
of  a  parametric  compiler  embedded  m  an  environment  that 
is  well-suited  for  semantically  describing  and  prag¬ 
matically  executing  a  large  class  of  languages.  The  semantic 
language  is  called  FLEX,  includes  the  compiler-compiler 
as  a  string  operator  and  is  used  as  the  basic  medium  for 
carrying  out  processes.  It  is  of  a  higher-level  nature 
and  may  itself  be  used  for  describing  many  algorithmic 
processes. 

The  machine  itself  is  designed  to  be  of  the  desk-top 
variety  and  sell  at  a  low  price.  Because  of  these  design 
parameters ,  many  compromises  m  time  and  space  had  to  be 
made  to  save  money,  ^he  software  system  is  implemented  in 
read-only  memory.  To  allow  any  possibility  at  all  of 
debugging  such  a  scheme,  the  algorithms  involved  were 
distilled  down  to  their  essence  sc  that  the  entire  system 
for  the  machine  can  be  displayed  (in  flow  diagram  form)  on 
a  small  wall  chart. 

In  many  senses  the  described  system  is  a  "syntax- 
directed"  computer. 
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Preface 


I  1 

Tnis  is  a  working  document  submitted  as  work-in¬ 
progress  for  the  degree  of  Master  of  Science.  It  propose* 
an  integrated  hardware- software  system  for  performing 
algorithmic  operations. 

The  following  is  intended  to  be  a  complete  and  concise 
description  of  the  system  rather  than  a  mere  report  of 
results  in  the  hope  that  readers  will  not  have  to  spend 
valuable  time  trying  to  figure  out  how  it  is  all  accomplished. 

Apologies  for  any  and  all  gaps,  chasms,  and  crevices. 
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II.  Introduction 

The  FLEX  language  is  intended  to  be  a  simple  yet 
powerful  and  comprehensive  notation  to  express  computer- 
oriented  algorithms.  It  follows  the  traditions  set  by 
ALGOL  60  and  several  generations  of  EULER.  [1,2)! 
a.  Calculation 

At  the  lowest  level  of  use  FLEX  is  easier  to  learn  than 
either  FORTRAN  or  ALGOL.  The  use  of  it  as  a  desk  calculation 
language  may  be  mastered  in  a  few  minutes.  For  example: 
we  may  wish  to  evaluate  a  qalculation  involving  only  numbers. 
The  expression  is  simply  entered  through  the  keyboard  as 
shown.  Assigning  the  answer  to  the  reserved  word  "display" 
indicates  that  the  answer  is  to  be  returned  to  the  CRT. 

'display*-!. 6*2. 9522/ (19.7-9.2) ; 


4.4985905 

At  this  level  of  use  the  entered  FLEX  code  is 
executed  statement  by  statement  so  that  it  acts  as  an 
interactive  language.  The  ”  '  "  is  supplied  by  the 
processor  and  indicates  to  the  user  that  FLEX  is  ready 
for  input. 


At  any  time  the  entered  text  may  be  modified  by 
using  the  powerful  text  editor  associated  with  the  language 
b .  variables 

The  next  step  for  the  initiate  would  be  the  evalu*» 

ation  of  simple  algorithms  using  variables  as  well  at 

constants  and  perhaps  a  more  interesting  display  of  results 

The following  routine  should  be  studied. 

- 

'begin 

new  a,b,o#d; 

b+l  ;c-«-19 .  3 ; 

disglay«-"as«w#  (a+b*c/1.2+c) 

#"d*"  «  4d+a-b+c*:U2) ; 

a=18.883333  b=30. 243333 

Notice  that  no  format  statements  or  separate  write 
commands  are  required.  The  handling  of  strings  of  textual 
characters  is  a  primitive  operation  within  FLEX  and  the 
catenation  operator  "#"  is  used  to  connect  together  literal 
strings  enclosed  by  quotes:  "a=",  to  numbers  generated 
by  executing  arithmetic  assignment  statements. 

The  whole  is  realized  as  one  string  of  characters 
at  the  display  end  and  is  Output  on  the  lower  half  of  the 
screen  as  shown. 
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The  creation  of  variables  is  indicated  to  FLEX,  by 
the  use  of  the  reserved  word  new  followed  by  a  list  of 
variable  names.  Type  netd  not  be  specified.  FLEX  is 
entirely  free  form  in  nature.  There  are  no  card  column 
numbers  to  worry  about  as  in  FORTRAN . 

c.  Decisions 

Decision-making  and  branching  are  handled  by  one  cemr 
prehensive  statement.  It  is  of  the  form  if  |w  |  then  |  | 

else  I  1 .  The  boxes  may  be  any  construct  in  the  language 
including  blocks  and  entire  programs. 

In  almost  all  cases  this  eliminates  the  need  and 
use  of  one  of  the  most  common  pitfalls  in  programming: 
the  label  and  associated  go  to  statement.  These  are 
provided  in  FLEX  but  they  will  rarely  be  used.  Former 
FORTitAN  programmers  who  convert  to  ALGOL  find  that  they 
almost  never  need  to  use  labels  or  go  tos  and  time  spent 
in  debugging  gets  reduced  by  a  sizable  factor. 

d.  The  Dse  of  Blocks  as  in  ALGOL  6O1 

The  scope  of  variable  identifiers  may  be  delimited 
by  further  use  of  the  parentheses  begin  end.  For  example: 

begin 

new  a,b,c,d,e,f; 


a+b+c+d+e ; 
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Within  a  block  delineated  by  a  begin  end  pair,  all 
identifiers  declared  by  a  new  list  are  considered  to  be 
local  to  that  block.  An  identifier  used  in  the  block 
but  npt  declared  there  will  be  the  one  declared  in  the 
nearest  containing  block. 

In  the  example  above  'a'  in  the  outermost  block  is 
given  a  value  in  the  assignment 
a+b+c+d+e ; 

following  this  a  new  block  is  entered  and  a  new  declaration 
is  executed:  new  a,b,c.  Effectively  this  overrides  the' 
previous  declaration  so  that,  in  this  inner  block,  the 


variables  a,b,c  are  considered  to  be  totally  new  and 
local.  In  the  assignment  of  identical  form: 
atb+c+d+e ; 

the  a,b,c  are  from  the  inner  blbbk  arid  the  d,e  are  from  the 
outer  block..  The  a,b,c  of  the  outer  block  are  not 
touched . 


ffhen  the  end  of  the  inner  block  is  reached,  the 
inner  block  ceases  to  exist;  we  ar$  again  in  the  scope  of 
the  outer  block.  The  assignment  f«-a+b  sets  f  to  the 
value  a+b  wh^re  a,b  are  the  outer  block  variables. 

'the  use  of  Block  Structure  in  this  way  allows  sections 
of  programs  Written  as  blockpto  be  arbitrarily  inserted 
without  fear  of  destruction  when  variable  names  happen  to 
vjUltdh  *•  can  easily  happen  in  unstructured  languages  like 
FORTRAN. 

I 

The  use  o£  the  word  new  means  just  that.  The  vari¬ 
ables  fallowing  are  created  fresh  each  time  a  block  is 
entered; 


NiW  binary  and  unary  operators  may  be  declared 
giving  the  programmer  powerful  control  over  the  language 
itself.  For  example,  the  functions  max  and  min  may  be 
useful  as  operators,  i.e.: 
begin  new  max,  min; 

bop  max  ■♦-'new  a,b.  if  a>b  then  a  else  b'; 
bop«min  ♦-'new  a,b.  if  a<b  then  a  else  b'; 


7 


a«-b+c*d  max  b-c*d,“  c,/lf  d>b,  then  a+-bM* 

In  this  manner  the  programmer  may-  tailor  the  operatofr 
structure  of  FLEX  to  suit  his  needs.  This  feature  both 
eases  the  programming  burden  and  causes  the  program  ±o 
be  easier  to  read  and  be  understood  by  others. 

FLEX  may  also  be  extended  by  either  modifying  itself 
via  the  compiler-compiler  contained  in  the  language  or 
a  wholly  new  language  may  be  created  using  the  same  tools. 
The  use  of  the  operators  com,  and  scribe  will  be  discussed’ 
in  a  later  chapter, 
f .  Comments 

Comments  are  handled  very  simply.  Any  text 

inserted  between,  the  symbols  ' ' ' '  will  be  ignored'  by 
FLEX.  This  allows  comments  to  be  inserted  anywhere— 
even  in  the  middle  of  an  arithmetic  expression. 

Examples : 

a«-b+c*d'  '  'this  expression  is  simple'  '  ' ; 
a-4-b'  '  'this  expression  is  simple'  '  '+c*d; 

This  introduction  has  barely  scratched  the  .surface 
of  the  FLEX  language.  It  was  not  intended  as  an  exposition 
of  FLEX,  but  only  to  give  the  average  user  (a  FORTRANer) 
a  feel  for  the  more  comprehensive  discussions  that  follow. 
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III.  The  Language  Environment 

A.  Explanation  o£  the  Forme  I leas  Peed 
Syntax 

Two  formalisms  are  used  to  describe  the  syntax  of 
FLEXt  A  variant  of  BNF  (Backus  Normal  Form)  (with  , 
factoring)  and,  the  syntax-chart  method  developed  by 
Burroughs  Corporation,  do] 

For  an  example,  let  us  describe  a  FLEX  identifier. 

In  English!  An  identifier  is  a  text  string 
of  arbitrary  length  starting 
with  a  letter  and  thereafter 
composed  of  either  letters  of 
numbers . 


In  BMFj 
in  Chart: 


<ident>t *“<letter>  |<ident> 
< letter >  |<identxnumber> 


. A  box  says  that  the  construct  is  defined:  elsewhere 
on  the  chart;  a  lozenge  indicates  that  this  is  the  definition 

Semantics  and  Pragmatics 

The  semantics  and  pragmatics  of  FLEX  will  be 
largely  described  in  English  (drawing  heavily  from 
accepted  notions  in  mathematics  and  computer  science) . 

Whenever  possible,  FLEX,  itself,  will  be  used 
for  description  and,  indeed,  this  is  done  in  the 
SCRIBE  chapter  where  FLEX  is  presented  written  in 
itself. 
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III.  The  Lanquaaa  Environment 

A.  Explanation  of  the  Formalisms  Peed 


Syntax 

Two  formalisms  are  used  to  describe  the  syntax  of 
FLEXj  A  variant  of  BNF  (Backus  Normal  Form)  (with  , 
factoring)  and  the  syntax-chart  method  developed  by 


Burroughs  Corporation .  do] 

For  an  example#  let  us  describe  a  FLEX  identifier* 


in  English*  An  identifier  is  a  text  string 
of  arbitrary  length  starting 
with  a  letter  and  thereafter 
composed  of  either  letters  of 
numbers. 

_  ■«  «ident>* t“< letter >  j<ident> 

in  amri  <  letter >  |<  ident »  <  number> 


in  Chart: 


ldftu  t 


A  box  says  that  the  construct  is  defined:  elsewhere 
on  the  chart;  a  lozenge  indicates  that  this  is  the  definition 
Semantics  and  Pragmatics 

The  semantics  and  pragmatics  of  FLEX  will  be 
largely  described  in  English  (drawing  heavily  from 


accepted  notions  in  mathematics  and  computer  science). 

Whenever  possible#  FLEX#  itself#  will  be  ased 
for  description  and,  indeed,  this  is  done  in  the 


SCRIBE  chapter  where  FLEX  is  presented  written  in 
itself. 


Bcoiuie  of  the  recursive  nature  of  FLEX  (and  the 
FLEX  deacription)  it  ia  impossible  to  describe  it 
in  a  linear  order.  Therefore,  some  reliance  haa 
been  placed  on  the  usert  intuition  for  soam  of  the 
examples  preaented. 

Exaaplea 

The  exaaplea  will  be  largely  preaented  in  FLEX 
although  occasionally  they  will  be  drawn  from 
ALGOL  (0  and  FORTRAN  to  preaent  some  interesting 
contraata. 

B.  The  FLEX  Language 

■MBwesaweeMMMBHi 

1*  Syntactic  Atoms 
Syntax 

<letter>si  ••A|l|...Y|z|a|b|...y|s|A| 

<digit> t «  -  0|l|2|3|...|9 

<deiiaiter> *' i  ■  ,  |i  |  (  |  )  |*  I’M  1 1  I*  S‘f,i*|r|j|~lM 


+  |-  |*  |/  M  1-  l<  l>  M  l>|A|\/|V| 

=  |*ltl£|»  |o  ^l|u|c)»  r  I*  I  I 


Semantics 

The  text  characters  are  simply  numbers  cf  small 
precision.  The  numbering  starts  with  (0,...,9)  for 
("0" , .  • .  ,"$*•)  and  continues  with  (10,12..  .60)  for 
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( "A"  "Z" )  and.  (11,13... 61)  for  («&" , 

A  special  space  symbol  is  nut&foer&d  €2.  The  delimiters 
are  numbered'  from  S3  on.  {true,  false)  are  identical 
with  (1.0)-. 

Pragmatics 

Text  characters  are  integers . 

Justification 

Many  internal  character  sets  have  been  used  fey 
the  industry.  The  principle  reasons  for  this  one 
are: 

1.  It  is  sortable, 

2.  It  is  easily  extendable  for  number  systems 
of  higher  radix  than  10. 

3.  It  eliminates  a  table  lookup  for  every 
character  that  is  input  to  the  compiler. 


cidentif ier > : :  «  <letter>  |  < identifier »  <letter> 
j  | < identifier >  <digit.> 

<integer>  ::  =  <digit>  j  ^integers  ^digit> 

<number>  ::  =  < integers { . t <integer> } } 

| . <integer> 

<text  char>  : :  =  <letter>  |  <digit^  j  <delim> 
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Semantics 

< Reserved  words>  have  the  form  of  identifiers  but 
are  considered  to  be  semantically  identical  to  <delimiters> 
Indeed,  many  <reserved  words >  have  their  exact  counterparts 
among  the  <delimiters> .  For  example,  begin  and  ( , end  and) 
are  exactly  identical  --  so  are  A  and  and,  v  and  or. 

< Identifiers >  are  considered  to  be  names  for  con¬ 
structs  in  the  system  and  the  basic  f.'iow  of  FLEX  consists 
of  assigning  these  names  dynamically  to  the  various  objects 
which  may  be  created. 

<Numbers>  are  either  integers  or  fractions.  The 
precision  will  be  unspecified  for  this  chapter. 


<primary>  :  : 
<variable>  :  : 
<parameter>  : : 


i 


list- 

H 

|  selector 

parameters 

V-, 

) 

b 

) 

=  <literal> | <variable> { <pararaeters > } 

=  { <op> } <identif ier> 

=  <list> { <pararaeter> } | < selector >{ <parame ter > } 

=  fi|OT|<list>{ <selector> { <parameter> } } | 
<process  description> | " <text  char>" 


<literal> 


Variables 


1.  ^simple  variable > 


la.  <ident> 


lb,  val<ident> 


lc.  map<ident> 


Id,  bop<ident> 


le.  uop<ident> 


Semantics .  , ,  Although  this  is  not  tike 
smallest  syntactic  uriit  for  a,  non* 
literal,  in 'some  casOs  it  acts  as 
the  smfillest  semantic  unit. 

Semantics .  This  has  attributes 
T.  name  ” 

2,  type 

3 ,  topology 

4,  value 

all  of  which  may  be  assigned  dynami¬ 
cally  .  _ _  ... 

Semantics*  The.  val  overrides  any 
value  that  may  have  been  assigned. 

On  the  left  side  of  the  assignment 
arrow  it  will  destroy  any  previous 
value . 

Justification.  This  allows  the 
programmer  to  override  name 
considerations  to  reassign  a 
procedure  quotation  and  to  access 
a  name. 

Semantics ,  This  allows  a  user- 
derTvecT  process  description  (pro¬ 
cedure)  to  be  assigned  to  the  access 
path  of  the  variable.  This  allows 
complicated  user  structures  to  be , 
indexed  in  the  same  manner  as  FLEk 
defined  data  structures.  The  map  is 
described  more  completely  in  the 
section  on  <selectors>. 

Semantics , .  This  moves  the  <ident> 
into  the  parsing  table  as  a  binary 
operator.  If  the  ident  has  had  a 
1 <Eody > '  assigned  to  it,  then  it 
will  act  £:s  a  binary  operator.' 

Pragmatics .  a  simple  name  inclusion 
using  the” generality  of  the  quotation 
to  full  advantage. 

Justification.  The  language  may-  be 
extended  in  a  simple  manner. 

Note:  Same  as  bop  except  <ident>  is 
parsed  as  a  unary  operator. 


Examples : 
p«- '  a ' 

P*-x+y  ' ' '  same  as  a+x+y ' '  * 
val  p*-'b' 

p+-x+y  ' ' » same  as  b+x+y  *  *  * 

bop  max-*- ' new  a,b;  if  a<b  then  b  else  a1 

2.  <simple  variables  <selector>  Semantics .  The 

<simple  variables*' ia 
assumed  to  contain  data 
Selection  is  performed 
as  in  ALGOL  60  and 
Euler .  Tt  acts  like  a 
simple  variable  after 
selection. 

3.  <s imple  variable >  <list>  Semantics .  This  is 

just  a  procedure 
activation  with  actual 
parameters. 

4.  < simple  variable>  <selector>  <list>Semantics .  selection 

is  performed  first. 

It  then  acts  like  a 
simple  Variable. 

5*  A11  further  generalizations  of  this , type  are 

evaluated  from  left  to  right  applying  procedure 
activation  and  selection  where  needed. 

Examples : 

®  t^/y/X]  (b,c,d) ;  1,1  "a"  is  an  array  of  procedures 1 1 1 
a  (b/C/d)  [x,y,zj;  *"  "a"  is  a  procedure  delivering  an  array' 
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b.  Literals 

L  ft  Semantics .  Means  undefined.  It  is  the  reeti&t 
of  illegal  operations .  All  identifiers  are'  set 

to  this  at  declaration  time. 

Pragmatics.  The  logical  word  is  flagged. 

Justification.  Allows  a  much  more  free  syntax 
while  stili  permitting  a  check  of  illegality. 

2.  *  Semantics .  Is  the  result  of  division  by  zero. 

It  is  also  used  to  map  extendable  arrays. 

Pragmatics .  The  logical  word  is  flagged. 

Justification .  Permits  checking  for  overflow 
and  declaring  unspecified  bounds  without 
giving  rise  to  a  fatal  error. 

3.  <number>  Semantics .  A  fraction  of  unspecified 

precision. 

Pragmatics .  Space  is  created  to  contain  it. 
Justification .  Useful  for  arithmetic. 

4.  "<text>"  Semantics .  A  text  literal  is  identical 

to  the  string  quote  of  ALGOL  60.  It  has 
as  wide  a  use  as  the  <number>.  Also,  it 
will  be  seen  later  that  com  ,,a+b*D"  is 
equivalent  to  'a+b*D't 

Pragmatics .  A  text  literal  is  mapped  and 
stored  as  a  one-dimensional  array. 

Justification.  Needed' to  generate'  text. 

Examples : 

if  a  ^  flthen  b«-a+1.34; 
if  a  -j-b  “then  display<-a 

else  display  •'■"error  in  a"; 
display«-if_  a*b  ^  “then  a  else  "error  in  a"; 
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<List>  t  :»b—  ln<lody> 
jndTT<»ody>) 


<Sody>i i -Declaration 
List> 

<St*tmmnt  List> 
|  < Statement  List> 


aenantigs.  The  maaning  of  a  list  depends  greatly  on  ite 
form.  All  lists  are  thought  of  as  executable  elements  that 
are  delimited  by  the  parenthetic  pairs  begin  end  or  (  ) • 
Execution  of  the  <Body>  takes  place  first.  What  remains 
(if  anything)  is  then  handled  as  an  operand. 

Taken  as  a  unit,  the  list  may  have  value  or  it  may  con¬ 
sume  itielf  during  execution.  If  a  declaration  is  present 
then  thd  list  acts  as  an  ALGOL  Block  in  that  identifiers 
declared  in  it  are  considered  local  to  the  list. 

Pragmatics.  The  extent  of  a  list  is  delineated  both  by 
parentheses  and  by  commas.  A  list  during  execution  is 
considered  to  be  a  vector  on  the  runtime  stack  whose 
topology  is  determined  by  keeping  track  of  the  list  of 
delimiters . 

Justification.  Here  we  have  one  concept  and  one  construction 
replacing  many  that  have  been  considered  useful  in  ALGOLic 
languages.  Also,  by  adopting  this  form,  mnay  useful  new 
constructs  are  possible. 
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Examples 

(a+bxc)  as  a  simple  arithmetic  primary 

((2,1),  (3,2))  as  an  array  literal'  * ' ' 

begin-*-a  b-foj  x-^a-b  end  '"  as  an  ALGOL! c  compound  statement"  ' 

prod  (a,b,'c+d')  '"an  an  actual  parameter  lint  '" 

begin  \"  as  a  valued  block  '" 

new  a,b,c. 
a«-a+(b+«*2+c) ; 
end 


The  Declaration  List 
Syntax 


declaration  List> :  declaration  List^}<Dedlaration> 

<Declaration>  t  :-«new<identif  ler  list>; 

< Identifier  List> ::={< identifier  list> , }«identifier> 


It 


semantics.  the  purpose  of  a  ^iara$8&©si  &e  to  create  attd 
determine  the '  scope  of  a  nama  which  Mil  serve  si  a  IKlia 
or  representative  of  gome  language  elements.  A  nasts 
has  as  Its  scope  the  <k»dy>  in  which  it  was  declares,  since 
both  type  and  topology  my  he  assigned  dynamically  nothing 
more  need  be  done  than  to  list  the  new  names  for  each  <body>. 

Wee  declarations  may  be  considered  to  be  executed* in 
the  sense  that  s  vector  e©nsisting  of  undefined  values  (Q) 
is  created  in  the  runtime  stack  for  the  duration  of  the 
block.  Positions  in  th©  vector  correspond  to  each 
identifier  declared. 

Justification.  Block  structure  has  proved  to  be  an  extratoely 
useful  and  important  concept  in  ALGOLic  languages.  Besides 
siding  the  programmer  greatly  in  his  own  debugging,  block 
structure  is  also  the  ideal  way  t®  delimit  the  scope  of 
users  irt  a  multiprogramming  and/or  time-sharing  environment. 


Examples i 

At beg In  ' ' ' a,h,c  are  local  to  block  A. ' ' ' 

new  a,b,c. 
a-*-a+  (b+c-2)  ; 

(b:  begin 


new  s. 

a^-b+c  f 2 ; 

end 

a*-a+2; 


' ' 'this  a ‘is  local  to  block  B  and  supersedes 

' ' 'the  previous  declaration.  b,c  are' ' ' 

'  * 'from  block  A. ' ' ' 

1  '  'this  a  is  the  one  declared  in  Block.  A' * ' 
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The  Statement  List 

Syntax 

< Statement  Li»t> :  :«{<StatemenJ:  List.-  ^  }■< valued  el— ent> 
<valued  element*  s  s*M  tvalued  element  * ;  }<stat— ent> 


Semantics  Both,  commas  anu  sem.  col  one  have  their  usual 
-Mi&'jL  meanings  although  th./  aie  allowed  a.  much  more 
flexible  usage.  A  comma  <lel._u  ..  ts  •■*  i.sments  in  a  vector  so 

it  may  be  considered  to  preserve  she  value  of  the  previous 
expression  or  statement.  A  senu colon,  then,  may  be  considered 
to  destroy  the  value  oi  the  previous  expression  or  statement. 

As  seen  aaove,  both  delimiters  may  be  freely  mixed  in  a  <bo<Jy>  . 

^y^htics .  A  semicolon  flu.snes  the  top  element  in  the  run**  ■ 
time  stack.  A  comma  increases  the  vs ’tor  count  by  1. 
and  leaves  the  top  of  the  stack  intact. 

Justif  ication .  As  seer,  m  tht.  examples ,  this  construct 
allows  great  freedom  and  flexibility  m  creating  lists  of 
values  and  is  pragmatically  quite  simple. 


Reproduced  from 
best  available  coP/i 
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Example#* 

(a,b,  (c,  1)  ,b+c)  '"simple  list '  * ' 

(lflf  a  than  b  else  c,  '"bore  is  left  depending  on  whether 

11  a  is  true  or  false*  ’ ' 

b*X*.5*(X+A/X) t  *  * ’Statements  followed  by  are  not 

retained1*' 

if  X2-A>e  then 

goto  0  else  ^.4S,  ' '  'value  of  b  is  left  wheti  sqrt 

algorithm  terminates  * ' ' 

x+y)  '"value  of  x+y  is  left"' 


The  Statement 


Syntax 


statement  :  :  =  <empty > j <expression> |  go  to  <statement>| 

<variable>-(-<statement>  j  >-var iable>as < statement> 
|  i_f  <  statement  >then<  stat  jment>else<  statement> 

| <identifier> : <statement> 

I  while<stntement'do<  statement  > 


Ifftlrtmen  \ 


■o 


variable 


fau-rncjir  |  I  variable 


ote>  hH  statement 


statement 


^statement  j  MJner, J — ^  statement- 1 - H 

- »T idenH statement 

statement  j — statement  | 


statement 


Semantics .  All  statements  are  considered  to  have  value 
except  for  the  go  to  statement  (which  is  not  considered 
to  be  a  fundamental  language  concept,  out  is  included  for 
practical  reasons).  The  go  to  initiates  an  unconditional 
branch  in  program  control  to  the  label  specified  by  the 
(label-valued)  statement'-.  For  the  same  reasons  the 
labeled  statement  is  not  considered  to  be  a  language 
primitive.  The  other  statement  types  will  be  considered 
separately . 


Pragmatics.  Since  the  syntax  of  a  <statement>  is  so  free, 
and  more  meaningless  constructions  are  permitted,  the 
limiting  factor  of  produced  nonsense  is  execution-time 
semantic  checking. 

The  values  of  the  statements  are  fetched  into  the 

runtime  stack  and  are  operated  on  in  turn  by  the  many 

» 

Operators  of  the  languages. 

Examples : 
abc :  a*b+z , 

go  to  if  a  then  abc  else  xyz  j 
xyz:  go  to  f  [a«-a+l]«-ab‘c; 


1  .(V/'p 


The  Expression:  A*  Presentation  of  Operators 
Syntax 


<expression>i  :*{<expressionxbiftary>  ><unexp> 


<unexp> 


t  *=<unary  op><unexp>  |  <primary> 


<unary  op>  :  **  Head  j  Tail  |  type  J  |  |  sin  j  cos  |  • 


com  scribe  ... 


<binary  op>  :  :=  t  |  *  |  /  |  //  |  mod  |  +  |  ~  |  *  |  |  <  | 

>  I  1  I  1  !  A  i  v  j  V"  j  =  |  ^  |  Of  I  is  1 ...  I 


<user  binary  ops>|  j  # 


rxcreas  j.or 


expression 


(binary  od — *\*ncxP 


0  ••• 


©"'  © 


funary  op 


unexp 


>rxman 


Note:  Binary  operators  are  given  in  order  of  precedence. 

Unary  operators  associate  from  the  right. 


Semantics .  All  operators  generalize  whenever  possible  to 
arrays  and  lists. 

a.  Unary  Operators 


Operator  Meaning 


logical  negation 
unary  minus 

floor  x:  integer  part  of  x 

ceil  x:  if_  floor  x=x  then  x  else  floor 
x+1? 
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w 


>;  i 
$ 


Operator 

£XE« 

head 

tail 

sin ,  cos 
abs 


Meaning 

yields  current  disposition  of  a,  primary 

first  element  of  a  list 

list  with  the  head  deleted 

the  usual  trig  functions 

absolute  value 


scribe  described  in  Section  C,  The  operand  is 
a  string  in  "scribe”  format  which 
defines  a  language.  The  result  is  'a 
set  of  tables  for  the  compiler-compiler 
(cdm)  in  effect  a  compiler. 

com  described  in  Section  C.  As  a  unary 

operator  com  accepts  a  string  for  one, 
operand,  and  assumes  ~he  FLEX  language 
tables  as  the  other.  The  refault  is  a 
compilation  of  the  text  resulting  in 
an  executable  process  description. 

b.  Binary  Operators 

Operator  *  Meaning 
Arithmetic 

+  x+y  means  xy  in  the  usual  mathematical 

sense  for  fractions 

*  x*y  means  x.y  in  the  usual  mathematical 

sense  for  fractions 


/ 


x/y  means  jj/y  in  the  usual  mathematical 
sense  for  fractions 


x+y  means  floor  (x/y)  in  the  usual 
mathematical  sense  for  fractions 


mod  y  mod  y  means  f  loor  (x- (x  y*y) )  in  the 

usual  mathematical  sense  for  fractions 

+  x+y  means  x+y  in  the  usual  mathematical 

sense  for  fractions 

-  x-y  means  x-y  in  the  usual  mathematical 

sense  for  fractions 


25 


Operator  '  Moaning 
relational. 

®»J*#  <#.<* A1  >>  yield  true  or  false 
logical 

r  t  t/ r=#  ,  the  usual  logical  operators  yield 
true  or ''false 

compilative 

described  in  Section  C.  As  a  binary 
operator  com  accepts  tables  created 
by  scribe  for  its  left  operand  and, 
for  its  right  operand  takes  a  string 
in  the  new  object  language.  The 
result  is  a  compilation  of  the  text 
resulting  in  an  executable  process 
description. 


the  to  operator  describes  a  range  of 
integer  values  either  atcending  or 
descending.  Useful  in  any  kind  of 
interaction.  A'  [3  to- -6]  means.  (a[3], 
a[4],  a[5],  a  [6],  ).  "abcdfg"{'2  to  5] 
means  "bcdf"..  ■  ' 

the  b£  operator  modified  the  interval 
within  the  range  of  a  to.  1  by  3  to 
10  means  (1,  4,  7,  10)-*" 


com 


range 

to 


associative 


of,  is,  isn,  These  operators  permit  the  formation 
and  storage  of  relations  between 
names . 

We  may  say:  John  is  son  of  Bill 
and:  Eric  is  son  oT  Bill 


We  may  then  ask  questions: 


x*?  i£  son  of  Bill/ 

-x  will  contain:  (’John?,  'Eric'} 

x*John  is  son  o£  ? 

-x  will  contain  ('Bill') 
x+?  is  ?  of  Bill 

-x  will  contain  (('son',  'John'),  ('son',  'Eric')) 

The  e  operation  yields  a  logical  result. 

The  possible  associative  operators  follow. 

form  meaning 

x  is  y  of  z  creates  and  stores  the  relationship 

x  isn  y  of  z  destroys  the  relationship  if  it  exists 

xey  of  z  asks  if  relationship  is  true 

x/£y  of  z  asks  if  relationship  is  false 

-~in  general  we  ask  for 

x  R  y  of  ?  all  z  having  relation  y  with  x 

x  R  ?  of  z  all  relationship  between  x  and  z 

X  R  ?  £f  ?  all  relations  that  x  is  involved  in 

?  R  y  of  z  all  values  with  relation  y  with  z 

?  R  y  of  ?  all  pairs  having  relation  y 

?  R  ?  of  z  all  relations  and  values  that  z  is  involved 

in 

Concatenation 

#  is  the  concatenation  operator.  The  result  is  the 
concatenation  of  the  two  operands .  The  topology 
of  the  result  is  the  most  general  topology  of  the 
two  operands . 


HOMOS 


f— . . 

A 

B 

AH' 

array 

literal 

extendable 

array 

-  *^ray 

ex  tenduble" 

-»rr»y 

list 

extendable 

list 

list 

_exiehdabT.^ 

array 

array 

list 


fist 


Pragmatics 
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a.  Unary:  operators  replace  the  t  op  ole-  ent  of  the 

process  stock  with  the  result, 

b.  Binary  operators  replace  the  top  two  elements 
of  the  process  stock  with  the  result, 

c.  The  associative  operators  are  really  trinary  in 
nature  and  therefore  three  names  are  actually 
collected  in  the  stack  before  any  action  is  taken. 
The  resultant  name  replaces  the  three  operands. 


Justification 

The  use  of  binary  and  unary  opera 
by  tradition  and  the  fact  that  fewer- 
needed  than  with  functional  notation. 


tors  is  justified  both 
parentheses  are 


Reproduced  horn 
best  avallakle-Cf 


copy. 


The  Expression:  B,  Generalization  ^ f  Operators 
Scope 

If  an  operation  is  legal  between  two  operands  then  it 
is  also  legal  between  other  structures  that  have  these 
operands  as  elements. 

Arrays  and  Lists 

If  the  dimensions  are  different  between  operands,  then 
a  logical  "adjustment"  is  moade  which  logically  createB 
enough  copies  of  the  operand  of  smaller  dimension  until 
the  dimensions  are  matched.  Then  the  operation  is  performed 
as  a  vector  operation. 

(a#  b#  c)  *  (x,  y,  z)  means  (a  *  x,b  *  y,c  *z) 
a  *  (x,  y,  z)  means  (a  *  x,a  *  y,a  *  z) 

(a,b)  *  (x,  y,  z)  meana  (a  *  x,b  *  y,z) 

Examples  of  Expressions: 

display  "a=" (b+2-4gc)  #"f="  #if  a<b  then  c  else -g; 

Note:  if  b-2,  g=3,  c=4  then  this  would  output  on  the  CRT: 


The  Conditional  Statement 
Syntax 

if  <statemcnt>  than  < statement*  e3  ee  <.statement> 


The  value  of  the  statement  fellwinjj  the-  if_  must  be 
reducible  to  true  or  false  (one  ®>r  sero) .  If 'a  oner 
the  statement  following  the  theft'  is  executed,  then,  the 
statement  following;  the  entire  conditional  statementls 
executed.  If  a 'zero,  the  sequence  is  similar  to  the  above 
except  the  statement  following  the  else  is  executed  instead 
of  the  then.  , 

The  entire  conditional  statement  has  a  value  equal  to 
that  of  the  executed  branch. 

Note:  This,  the  so-called  "Long-form:  of  the  if 
statement,  is  the  only  type  presently  available.  It 
includes  the  "shortform:  semantically  since  the  empty 
statement  is  allowed.  If  it  proves  awkward  to  use,  then 
the  short  form  will  also  be  added. 

Pragmatics 

:  There  are  only  two  jumps  needed  in  the  underlying 
environment:  Jump-Unconditional  and  Jump-if-top-stack- 
*©ro.  These  are  invisible  to  the  user  and  are:  inserted 
during  the  parse. 


Examples i 
if  a^b+c-d+et. 5«G 
them  b«-*a+b' 
else  b+’a-b';.... 

if  a<b<c 
then  (a-Hs;  b-*-c) 

elser  ,,,use  of  empty  statement'1’ 
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The  Assignment  Statement 

Syntax 


variable 


Semantics 


^  variable>«-<statement> 


The  value  of  the  assignment  statement  ia  considered  to 
be  the  value  of  the  <statement>  and  is  designed  to  the 
variable  in  a  number  of  ways  'depending  on  which  attribute 
of  a  variable  is  to  be  assigned. 

As  will,  be  seen  later ,  besides  attaching  a  minor lo 
».iue  to  a  name,  we  may  also  dynamically  specify  the 
particular  topology  of  that  value.  This  includes  gross 
structure  such  as  whether  the  data  is  an  array  of  such 
and  such  site,  is  a  single  item,  or  possibly  a  directed 
graph  or  tree.  Fine  structure  may  also  be  indicated. 

An  item  can-  be  considered  to  be  a  number,  a  character,  a 

byte  of  any  didth,  a  quotation  of  a  program,  a  record,  etc. 
Pragmatics 

The  «-operator  has  a  value  for  its  right  operand  and 
a  name  for  its  left  operand.  The  value  is  left  in  the 
stack  and  the  name  is  destroyed. 
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Examples: 
a+b+c  , 
a-*-' b+c* 

a4-array  (x.  (5*b,c) ,  (1,2) ) 

(if  a<b  then  a  else  b ) 4-b+c 

a4-b4-c4-b+c 
a-*-b*c+  (d4-b+c) 
a4-''b+c" 


"•value  of  b+c  Is  named  a'" 

* ' ' a  becomes  the  name  for  the 
procedure  b+c ' 1 1 ; 

"•a  is  mapped  as  a  two- 
dimensioned  array  whose 
elements  are  x  bits  wide? ' • ; 

' ' 'either  a  or  b  is  assigned 
b+c  depending  on  previous 
values  of  a,b" 

'"multiple  assignment'"; 

' '  'nested  assignment* 1 1 ; 

"'assignment  of  a  text 
literal"*; 
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The  Assume  Statement 
Syntax 


<variable>  as  <statement> 


Semantics 

This  is  a  generalization  of  the  assignment  statement 
in  that  the  <variable>  "takes  on"  or  "assumes"  values 
indicated  by  the  <statement>  one  at  a  time  if  a  loop  is 
indicated  by  an  interative  while  statement.  Outside  of  a 
while  only  the  first  possible  value  is  assumed  and  execution 
continues.  .The  value  of  the  assume  statement  is  boolean: 
being  true  if  the  variable  has  just  assumed  a  value  and 

false  when  there  are  no  more  possible  values  which  may  be 
assumed. 

Pragmatics 

The  ££  operator  has  a  value  for  its  right  operand 
and  a  name  for  its  left  operand.  After  all  possible 
assignments  are  done,  the  value  in  the  stack  is  replaced 
by  a  boolean  value. 

Justification 

This  particularly  general  form  is  most  useful  in 

iteration  .and  applies  itself  well  to  all  kinds  of  operands. 
Examples 

Will  be  given  in  the  section  on  the  while  statement. 


! 


'  menMavMMx  «KettgsamnnkH  {*•«}  em 


'•#,f  ;  J/  **'i 


The  Iterative  Statement 
Syntax 


~h*le  <8tatement>  do  <statement> 

Semantics 

The  statement  following  the  do.  will  be  executed  as 
long  as  the  statement  following  the  while  is  true,  if 
it  becomes  false,  then  control  transfers  to  the  next 
sequential  statement. 

Pragmatics 

Similar  to  the  if  statement  except  that  a  jump  back 
is  inserted  after  the  statement  following  the  do. 
Justification 

Besides  covering  a  great  many  iterative  situations 
in  a  Simple  manner,  the  while  statement  allows  for  the 
complete  cessation  of  use  of  the  go  to  and  <label>. 
Examples i 

1  2£L  1  *>£  2  to  13  '"as  an  ALGOLike  for  statement' 
do  <fetate>; 

while  I  as  1  x<5  "'as  ALGOLike  for  while  state"' 

do  <state>; 

2i!ii£  1  as  (1, 5,3,1  to  10,3  b£  -2  to  -1)  '"whichever  lis 

J  ~  <5'10'A  &)£:  B  C)  ■  '"funs  out.  first  wil: 

do  <state>; 

terminate  executior 


while  X  as  ( (Jones  is  parent  of?) A  (male  is  sex  of  ?)) 
do  <state>;  ' ' 'X  will  assume  all  sons  of  Jone8,,, 


6,  The  Proosas  Description 
Syntax  ‘ 

cprocess  description :  l* 

'  <’Body>' 


Semantics 

The  process  description  is  the  backbone  of  the  PLKX 
language.  The  user  at  a  console  is  considered  to  be  inside 
a  process  and  he  is  handled  by  the  system  as  just  another 
active  process.  • 

The  quotation  may  be  named  in  the  same  manner  as-  ether 
literals  in  the  language.  A  process  may  be  created  free  the 
process  description  in  one  of  two  ways:  as  a  serial 
procedure  which  is  executed  before  the  calling  program 
is  resumed#  or  as  a  parallel  execution  entity  which*  runs 
concurrently  and  independently  of  the  parent  process. 

In  either  case#  if  a  new  follows  the'1,  the  variables 
named  are  taken  to  be  the  formal  parameters  of  the  process 
description. 

Pragmatics 

The  <Body>  enclosed  by  the  quotes  is  compiled  separately 
and  set  aside  in  the  same  manner  as  other  literals.  If 
it  is  named#  a  reference  is  placed  in  the  variable  name 
area  where  it  may  be  easily  retrieved.  A  new  stack  is 
created  for  each  process  and  an  event  notice  is  entered 
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into  the  process  que.  User  processes  are  executed  on  "a 
"round  robin"  basis  with  =.  time  quantum  of  about  10-16  Mia. 
Process  e'J  that  are  alive  mav  be  active  or  passive ;  these 
states  may  be  changed  by  themselves  or  by  an  interrupt 
by  the  real  time  processes. 

Justification 

Procedures  and  data  hand  1 irg  arc  the  keys  to  6 

successful  language.  In  FLEX  both  these  concepts  have 

beer,  generalised  in  a  powerful  manner. 

Examples  of  simple  proceaures; 

+•  b';  ’''a  "run-time"  equivalence  statement '  J  1 

*.  'b+c'?  '  '  'simple  quotation  without  parameters  '  1  ' 

4-  if  b<c  then  'b+c'  else  'b-c1  ;  !  '  'conditional 

assignment 1  r  ' 

4-  s ;  '  '  ’the  name  i  j.s  assignee  to  the  value  of  b'  '  ' 

4-  z ,  '  '  'the  name  b  is  assigned  to  the  value  of  z'  1  ' 

4-  ' c';  '''a  is  requivalenced  to  c1'' 

4-  x'  '  '  1  the  name  z  rs  assigned  to  the  value  of 

b+c’" 

4-  z;  '''a  pragmatxc  error  is  generated  since  x  is 

a  value ' ' ' 


\ 

7 

o 

a 

val  a 
z 

x 


for  +  'new  a,  b,  c,  d,  e,  '"an  ALGOL  ike  "for"  procedure''' 
a  *  b; 

loop:  if  a  <_'  d 

then  (e;  a  •>-  arc;  goto  loop) 

I  , 

r 


else 


ALGOL 

f££  I:  =1  step  1  until  50  do 
begin  a  :[IJ  :  =  i  +  5; 
b  [I  +  2]  :  *  I 

end ; 

Note:  a,b,e,d,e  are  the  formal  parameters.  Enclosing  an 

actual  parameter  in  quotes  is  equivalent  to  the 

ALGOL  "call  by  name”.  Unquoted  actual  parameters 

are  equivalent  to  value  calls.  Nesting  is  obviously 
easy. 


FLEX 

for  Cl',  1,  1,  50 , 

'a  [IJ  «-  1+5;  b  [1+2]  +  I'j 


a Ph«  "Case”  Statement 

One  of-,  the  most  useful  concepts  in  programming  is  the  . 
protected  branch.  This  is  illustrated  by  the  if*  stateia&nt* 

if  B  then  <stat>l  else  <stat>0 


It  is  quickly  accomplished  in  FLEX  by  the  following  method: 

a  *  ('^stat  0>'  ,  1  <stat  1> '  ,  **\  V<statn-1>',  '<statn>') 

and  used: 


a  [B]  ; 

Parallel  Processing 

If,  in  the  previous  example,  the  entire  vector  was 
indicated  instead  of  jupt  one  element: 


a; 


than  FLEX  would  execute  the  n  statements  in  "parallel". 

This  is  also  a  protected  scheme .  The  global  process 
is  passive  until  all  of  the  h  statements  are  done.  To 
create  and-  release  a  process  which  will  execute  concurrently 
with  the  global  process,  the  following  is  done: 

act  for  ( «T ' ,  1,1,  58,  'b  [I]  *  I’); 

The  for-loop  will  be  executed  in  parallel  with  the  state¬ 
ments  following  this  call: 

We  may  also  do: 

a  *■  '  ( 1  <stat  0>'  ,  '<stat  1>'  ,  •  •  •  ■, * <stat  n-l>' ,  ' <stat^n>? )  j f 
act  a; 

The  n  statements  will  be  executed  in  parallel  with  the 
global  process  and  with  themselves. 

Coroutines 

•  ■'  i  • 

Another  useful  concept  in  programming  is  the  coroutine 
which  is  simply  a  process  description  which  allows  a  return 
from  the  middle  of  the  code.  The  exit  point  is  sayed  and, 
when  the  code  is  again  called,  control  is  transferred 
to  the  previous  exit  point  rather  than  to  the  beginning. 

The  leave  reserved  identifier  facilitates  this  feature— 
it  indicates  to  the  event  scheduler  that  the  current 
process  is  to  be  passivated  and  the  current  program  step 


saved . 
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7;  The  Selector 


<Selector> : [<Body>] 

Semantics 

The  construction  [<Body>]  is  used  to  pass  parameters 
to  the  access  mechanisms  of  FLEX.  It  is  used  both  with  the 
FLEX  mapping  operators  array  and  f xeld,  and  with  user- 
defined  maps  to  select  from  some  previously  defined  data 
W  structure. 


A  data  descriptor  may  be  marked  with  the  information  that 
a  segment  is  mapped.  The  map  is  executed  to  finally 
produce  a  data  descriptor  of  the  selected  element. 
Justification 

The  separation  of  structure  and  data  is  the  prime 
consideration  in  any  useful  file  system  and  allows  great 
flexibility  as  well  as  the  use  of  "stupid"  channels. 


s  '-.r 


< define  array > ; :«°array  Li«t 
<define  f ield> : s=f ieid  List 


Semantics 

a.  Array 

.  Ths  first  parameter  is  the  byte  size  of  the  elements 
in  bits.  The  following  parameters  describe  the  lower  and 
upper  bounds  of  each  dimension  of  the  array .  A  logical 
"procedure"  is  assigned  to  the  map  of  the  variable.  The 
actual  parameters  are  reconciled  with  the  bounds  when  an 
access  is  requested  to  produce  a  descriptor  or  a  value  of 
the  element  selected. 

b.  Field 

The  operator  produces  a  logical  procedure  which  may 
be  assigned  to  a  variable  just  like  any  other  quotation. 

The  procedure  operates  on  a  descriptor  describing  a  field 
of  bits  to  produce  a  description  of  a  new  field.  The  first 
parameter  is  the  offset  bits  of  the  new  field  in  relation 
to  the  old.  The  second  parameter  is  the  end  bit  of  the 
new  field. 
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Pragmatics 

Both  routines  are  called  and  executed  like  any  other 
simple  procedure. 

Justification 

These  routines  allow  the  user  to  extract  an  arbitrary 
sequence  of  bits  from  some  other  sequence  of  bits. 

Examples : 

a  *-  array  (7,  1  to  10,  -255  to>  0)  "'a  is  mapped  as  a 

two-dimensionaT  array  whose  elements  are  7  bits  wide' 1 ' 

a  (5,  -3]  11 ' selection  of  a  byte’ 11 

a  [5,]  ’ ' ' selection  of  a  row ' ' ' 

a  12  to  5,  -10  to  -2]  '''selection  of  a  new  square  array''' 
id  field .  (0  to  15)  ;  wages  ■<-  field  (16  to  31)  ; 
son  field  (32  to  3  2  4-  16)  ;  son  2  field  (3  2  +  15  to  63)  ; 
' ' 'this  is  a  definition  of  the  fields  of  a  64  bit  wide 
record,  a  use  follows''' 

employee  •+■  array  (64  ,  JFto'.lOOO)  ;  employee  tape  2; 
display  wages  (employee  [3  to  15]), 
display  employee  [son  (employee  [5])]; 


C.  The  SCRIBE  Language 


Introduction 

Although  SCRIBE  is  a  super-set  of  the  core  language 
FLEX,  it  is  presented  last  with  the  feeling  that  some 

intuitive  grasp  of  the  language  environment  will  have  been 
achieved  by  now. 

SCRIBE  has  its  roots  in  the  "Floyd-Evans  production 
scheme"  f4,5]  and  FSL  [6,7].  Basically  it  is  a  bottom-up, 
bounded-context  recognizer  that  uses  FLEX  as  a  sublanguage 
to  express  semantic  relationships.  Because  of  its  bounded- 
context  properties,  it  will  deliver  the  canonical  parse  of. 
a iy  language  (which  may  be  expressed  in  this  form)  without 
backing  up.  This  ability  allows  a  one-pass  compiler  to  be 
created  simply  and  compactly;  ideal  attributes  for  inclusion 
in  the  hardware  of  a  machine. 

The  Basic  Elements  of  SCRIBE 

There  are  four  levels  of  description  necessary  for 
creating  a  language  translator:  meta  declaration,  terminal 

declaration,  the  syntax  algorithm,  and  semantic  relation¬ 
ships. 


Meta  Declaration 


(<ident>) 


Semantics 

— — — r 

A  meta  symbol  in  SCRIBE  is  an  <identifier>  which  has 
the  same  use  as  fche  symbols  enclosed  in  <>  in  BNP;  it  is 
used  for  taxonomic  purposes  as  a  generic  or  class  name  for 
a  certain  construction.  The  meta  symbols  ident,  delim, 
text  are  automatically  included  in  any  meta  symbol  list. 
Pragmatics 

The  meta  symbols  are  transliterated  to  unique  integers 
which  may  b*  used  in  generating  the  canonical  p^rse. 
Justification 

The  use  of  meta  symbols  as  class  names  is  well- justified 
in  phrase  structure  language  theory. 

Examples : 

metas  (a$xp,  term#  factor,  prim); 


tfcrm  entry 


-gnp  (<t*xali8t»i 

<t*t»  [<ttn  ltst>,J  <tera  ©atry> 

<***■  ©ntry>  t  *•  <i«lk>  J  <ident>  |  <oguatc>  |  <c 

tiilfiMkt 

««P*t8>|»*  (<OfU*t©  list>) 

<#fM±e  li«tM«-  [<eguate  list>,J  <egentry> 

<4©Xia>  |  <ident> 

<olee@  assignments **  <ni(sta  name>  «-(<t»rm  list>) 

semantic 

^•ttttisasl  symbols  are  the  syntactic  atomB  of  a  language. 
In  theory  they  are  treated  as  single  characters  but, 
because  of  llnttAtions  of  character  sets,  aggregates  of 
characters  may  also  denote  a  terminal  symbol.  For  example: 
+  and  -  ar©  terminal  in  FLEX  and  so  also  are  begin 
and  newt  identifiers  whose  meaning  is  reserved.  SCRIM! 
allows  terminal  symbols  to  be  declared  either  in  the  form  • 
ef  single  character  delimiters  or  as  identifiers. 

It  may  be  that  more  than  one  representative  for  a 
terminal  ia  desire**  for  purposes  of  serving  more  than  one 
character  set  or  for  clarification,  begin  and  "("  are 
an  example  fro*  FLEX.  Syntactically  the  two  representations 
f3*e  equal  and  may  be  declared  in  SCRIBE  as  an  equate: 

(begin,  "("). 

Many  terminal  symbols  may  belong  to  the  same  syntactic 
class  and  an  ability  to  assign  them  to  a  meta  symbol  can 
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save  a  great  deal  of  effort  in  writing  the  syntactic  algorithm 
The  multiply  operators  provide  an  example;  they  are  usually 
assigned  the  same  level  of  precedence  and  this  fact  can 
be  indicated  in  SCRIBE  by  the  class  assignment:  mop  «-  ■  { 

This  provides  an  abbreviation  or  "parse 
name'.'  for  the  three  delimeters. 

In  fact,  every  terminal  symbol  can  be  considered  to 
have  both  an  "external  name",  which  is  the  character 
itself,  and  a  "parse  name’)  which  is  either  the  same  as 
the  external  name  or  is  a  meta  symbol  indicating  membership 
in  a  class.  All  comparisons  in  the  syntax  section  are  done 
on  the  parse  name. 

Pragmatics 

A  table  is  built  from  the  indicated  relationships  so 
that  the  textual  scanner  may 'separate  the  terminal'  symbols,  and 
discover  their  external  and  parse  names. 

Justification 

The  terminal  declaration  supplies  a  finite  state 
algorithm  in  the  machine  with  enough  information  to 
completely  strip  down  the  text  into  primary  syntactic 
atoms  which  is  typically  the  dirtiest  30b  in  compiling. 
Examples : 

'''from  both  sections--to  declare  all  symbols  necessary 


for  handling  arithmetic  expressions'1' 
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metas  <-  (aexp,  term,  fact,  prim,  aop,  mop)  ; 


terms  «-  (  "(",  ")",  '  " ,  "exp"),  mop  "*"), 

aop  <-  ("+",  "-")); 


SO 


3.  The  Syntax  Algorithm 
Syntax 


s yntax  ■»-  ((pattern  list)  ); 


(pattern  list)  :: 

^(pattern  list)  (pattern) 

(pattern)  ::  = 

1  (stack  pictures)  "1  (seman tic)  ,^can)  ,  go 

1,1  "(ident)  :  (pattern) 

(sta ck  picture) 

-  ?<mefa  symbol >•«-}  (parse  names) 

(parse  names) 

"  =  {{{(symbol)]  Cymbal) (symbol)}  (symbol) 

(symbal>  : 

A  |(meta  symbol)  |  (term  symbol) 

(semantic)  : 

:  =  (  ident  >  |t  empty) 

(scan)  :: 

“  scan  |  scan  2  |  ^einpty^ 

fkstt&fttice 


When  a  scan  'cmamnd  is  issv.*e ,  fcb®  tawt  at  'th*e  current 
point  i&  scsutisiis:®*!  &n<d  &  t«sss&i»&i  «vujfe©l  is  isol&t«d . 
This  is.  looked  up  in  tins  tafeie  that  wae  boated  by  fJ&@ 
terms  declaration  and  this  wars®  tsatews  and  ©x terns!  of  the 


ejmbol  is  pushed  into  the  garae 
ibtaoawlai: 


text  t 


a  ia 

m 


j  a  j  +  j  to  -j  ,  a  j  3  >  j  *  s  K  •  s  t 


pares  stack 
after  3 
scans  * 


I  J  K 
4  i  .  ••*■ 


i<u,  •»  >.-W.  :>f.  -.•<»  .tiwitoMam^s  t-t  vti-ktfaWAteaMmAuntfr 

ident  ao©  idem: 


I _ L _ L _ _ 


... parse  name  field 
•„.»  .ext-hsuae  field 
. « -value  field  ■ 


'The  parse*- name  field  in  the  stack  contains  the  class  ;. 
names  for  the  two  identifiers  and  the  "t".  The  value  field 

t 

which  is  used  by  the  semantic  processor  is  blank, 

A'  pattern  to  recognize  this  configuration  would  be: 

|  aexp  4-  ident  aop  ident  j  sum,  scan,  ujjs  axpj  err  1  j  ,- 
The  section  "ident  a.cp  ident"  asks,  if  that,  configuration 
is  present  in  the  stack.  It  is,  so  the  semantic  routine 
"sum"  is  executed.  This  will  be  a  routine  written  in  FLEX 
arid  defined  in  the  next  section.  It  will  be  able  to  use 
the  pointers  I  and  J  which  after  a  successful  pattern  match 
are  set  to  the  lower  and  upper  bounds  of  the  pattern  in 
the  stack. 
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(K  always  points 


I  J  K 

+  +  t 

parse  stack  | _ 

ident  .  aop  j.  ident 

after  a  | 

' aal  ’  |  "+■"  |  *fo4a3 ' 

match;  1 

•  1  * 

o  1  o  i  o 

to  the  top  of  the  stack). 

After  the  return  from  the  semantic  routine,  the  first- 
section  is  examined  to  see  whether  or  not  a  reduction  its 
requested.  '  "aexp*-"  is  present  so  the  region  cf  the  stack 
between.  I  and  J  .will  be  replaced  with  "aexp"  in  location- 1. 

‘ : .  ■  .  •  I  J  K 

^  4  i-rr:  .. 

patse  stack  j^iaexp:  '!  v . , 
after  Jt^ie  .  [■  '  '  'I'ai^al  -  ( 
reductions  |  0  j  . , . 


Now  the . <scan>  field  is  examined,  A  single  scan  is  requested 

and  executed.  ; 


texts  ■  r  a  |.  a  ij'^avpTT 


a 


parse 

stack  ] 

aexp  J 

mop 

after 

scan:  [_ 

'•aal.’i 

»  ¥l 

L 

— j  1 

0 

lastly,  the  go  is  executed  and  control'  is  passed  to 


another  pattern 


in  this  'case , 


the  pattern  labeled- 


"axp" , 


I 


w 

*5 


If  the  pattern  match  had  not  been  successful,  then  the 
last  field  would  have  been  examined.  If  <eapty>  control 
would  be  transferred  to  the  next  sequential  pattern. 

If  an  <ident>  is  present,  then  the  semantic  routine  waned 
by  the  ident  will  be  called— for  this  case  it  would  be 
"errl" . 

A  “A®  will  always  be  accepted  in  the  match. 

Pragmatics 


The  handling  of  text,  parse  stack  and  patterns  i3 
accomplished  by  a  compact  "wired-in"  algorithm.  The  pattern* 
themselves  require  only  64 'bits  apibce. 

Justification 

The  algorithmic  form  of  the  syntax  handler  though 
somewhat  removed  from  the  phrase  structure  descriptive 
method  allots  the  user  much  more  knowledge  of  what  is 
going  on  at  each  point  and  thus  makes  for  a  very  aompact 
description  of  a  language.  It  is  this  feature  which  allows 
the  tables  for  FLEX  and  SCRIBE  to  be  implemented  in  hard¬ 


ware. 
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example  111  combining  the  above  three  sections  to  form  a  recognizer  for  arithmetic 
expressions'  1 1 

metas  ■*-  (aexp,  term,  factor,  primary,  aop,  mop); 

terms^r-  ("f", "exp") ,  mope-("*", "  "),  aop-- ")); 

syntax--  ( 


storh  | 

t. 

,  scan 

, go  atoms 

otoins:  1 

II  /II 

,  scan 

,go  atoms 

1 

aop 

,  scan 

,  go  atom  1 

atom  t  |  primary  «#- 

ident 

idt 

,  scan 

, go  prim 

| primary 

num 

nm 

5  scan 

, go  prim 

prim:  |  factor»-factor 

primary 

is. 

opr 

t 

, go  fact 

|  factor 

primary 

t. 

» 

, go  fact 

fact:  1 

factor 

m|ii 

,  scan 

, go  atoms 

j  term**-  term  mop 

factor 

A, 

opr 

> 

, go  term 

|  term 

factor 

A 

> 

, go  term 

term:  1 

term 

mop 

,  scan 

, go  atoms, 

1  aexp  ♦-aexp  aop 

term 

A 

opr 

,  scan 

,go  aexp 

|  aexp  *-  aop 

term 

A 

unsura 

f 

aexp 

| aexp 

term 

6, 

f 

aexp 

aexp:  1 

aexp 

aop 

,  scan 

,go  atoms 

(primary  4-  "(" 

aexp 

Myi 

,  scan 

. go  prim 

1 

aexp 

A 

I 

> 

,jgo  halt 

Notice  the  similarity  between  the  above  and  the  phase  structure  definition  for 
arithmetic  expressions : 1  ' ' 

<aexp>:  :  =  ^exp]>  &op>  <term^ 
l^aop^  4termi> 
t  ^term^ 

4  term) : :  =  (term)  <mop>  (.f  ac  toi^ 
i  4 factor  "> 

^factor):  :  =  (factor>t  ^primary) 

J.  4  factor) 

< primary); ident  |  num  )  (<aexp>) 

<aop>:  :=  +|- 
<mop>:  ;=  *|/  l-r 


4.  Semantic  Relationships 
Syntax 


Semantics 

All  identifiers  used  in  the  semantic  fields  are  con¬ 
sidered  to  be  global  to  the  <list> ,  as  are  the  various  system 
routines  to  aid.  the  compiler  writer.  The  identifiers 
must  be  defined  by  a  quotation  assignment  in  the  <list>. 
Additional  content  in  the  <list>  is  left  to  the  programmer/  s 
discretion.  The  system  aids  will  be  described  separately. 
Pragmatics 

Essentially,  the  semantics  are  in  the  form  of  a  <case> 
statement  with  each  <case>  bsihg  one  of  the  identifiers 
found  in  the  semantic  fields  of  the  patterns. 

Justification 

The  use  of  FLEX  as  a  powerful  descriptive  language 
for  providing  semantic  referrents  to  the  maching  allows 
translation  building  to  be  relatively  easy. 

Examples 


(Will  be  given  after  exposition  of  system  aids) 


Global  Delta  Structures  and  Algor.lt hm s 
A .  The  Symbol  Table 

The  symbol  table  is  a  stack  in  which  information  may 
be  retained  about  < identifiers*  in  the  system.  Automatic 
controls  for  handling  block  structure  are  provided. 


JJ  -  | 


1- . _J  _ J_ _ j 

11  +  1  I  1 _ I 

i  I  ! 

. . ! _ _ _ _ _ _ 

name  flag  value 

Symbol  Table  Routines 
New  Block 

II  and  JJ  delimit  a  block  of  symbols.  New  block 
causes  a  push  to  occur  and  II  and  JJ  are  reset  to  handle 
a  new  group  of  symbols . 

Old  Block 

A  P°P  of  the  symbols  delimited  by  II  and  JJ  is  performed 
and  II,  JJ  are  reset  to  their  lower  level  values. 
find  (name,  from,  to,  found) 


A  search  is  performed  in  the  range  specified,  "found" 
is  set  to  true  and  a  global  variable  LL  contains  the 
desired  location  if  a  match  occurs.  Otherwise  "found" 
is  set  to  false. 
enter  (name,  flag,  value,  enor) 

A  search  is  performed  in  the  current  block.  if  a 
match  is  not  made,  then  the  "name,  flag,  value"  in'di  ated 
are  pushed  into  the  current  block.  If  a  match  was  made 
denoting  that  a  symbol  with  the  same  name  already  exists 
in.  the  current  block,  "error"  is  set  to  true  and  no  entry 
is  made. 

5 • .  Code  Generation 

System  aids  in  this  area  are  currently  somewhat 
primitive.  A  canonical  parse  will  deliver  operators  and 
operands  to  the  semantic  routines  in  a  polish  post,  fix 
order  all  that  need  be  done  is  to  generate  the  two  kinds 
of  operators  that  the  FLEX  polish  requires.  The  following 
routines  will  eventually  be  replaced  with  machine  independent 
aids, 
sop  fop) 

In  the  FLEX  machine  simple  operators  are  identical 
with  their  delimiter  representation,  sop  ("+")  will 
generate  an  "add"  command. 
cop  (op,  value; 

Compound  operators  are  necessary  for  specifying  declara¬ 
tions,  variables,  procedure  calls,  etc.  Their  description 
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and  use  is  supplied  in  Section  V  on  pragmatics  of  the 
machine.  The  user's  intuition  will  be  relied  on, 
a  aval  lloc,  value) 

Stores  just  into  the  value  field  of  a  compound  operator 
at  the  specified  location, 
strop  f. loc,  op) 

Stores  just  into  the  value  field  of  a  compound  operator 
at.  the  specified  location. 

Global  names 

"cpd"  is  the  current  process  description  segment  into 
which  code  is  being  generated.  "P"  is  the  current  code 


location. 
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Examples;  a  simple  compiler  for  arithmetic  assignment  statements  delimited 

by  "  #  " 


metos  (body,  stat,  aexp,  term,  factor,  primary,  aop,  mop); 


temis  4~  ("  ; 

",  "(,)", 

II  II  II 

/ 

",  mop  (" 

*  ii  11/  n  II 

/  /  f 

"), 

aop  ("  +  ", 

II  ^  II  j 

); 

Syntax 

(.  1 

* 

y  scan 

go  start, 

Start:  |  Body  +— 

"  #  " 

Set  up 

,  scan  2 

go  on 

err  1 

On:  1 

ident 

" 

y  scan 

go  atoms 

err  2 

Atoms:  1 

H  ^11 

,  scan 

,go  atoms 

1 

1 

aop 

,  scan 

, go  atom  1 

9 

Atom  1 :  |  primary  *- 

» 

ident 

idt 

,  scan 

,go  prim 

9 

|  primary 

num 

nm 

,  scan 

,go  prim 

9 

err^ 

prim:  (  factor  factor  "f" 

primary 

A 

opr 

» 

,go  fact 

9 

I  factor 

primary 

A 

> 

.go  fact 

t 

fact:  1 

factor 

ii 

,  scan 

, go  atoms 

9 

|  term<-  term  mop 

factor 

A 

opr 

» 

.go  term 

9 

|  term  *— 

factor 

A 

> 

.go  term 

9 

term:  | 

term 

mop 

,  scan 

.  go  atoms, 

|aexp<t-  aexp  aop 

term 

A 

opr 

,  scan 

.go  aexp 

9 

(aexp  4-  aop 

tern 

A 

unsum 

* 

aexp 

9 

|aexp  <r 

term 

A 

* 

aexp 

9 

aexp:  1 

aexp 

aop 

,  scan 

, go  atoms 

9 

[primary  4-  "('' 

aexp 

ti^n 

,  scan 

,go  prim 

9 

[state*  ident  ' 

aexp 

A 

assign 

9 

,  go  fold, 

err  3 

Fold:  |body*p  body  stat  " 

9  scan  2 

,  go  arr, 

jbody  body 

stat  "#  " 

9 

,  go  half, 

err  4 

Semantics  *•  ( 

set  upVnew  biock;  cop  ("new", A)  "'set  up  for  handling  variables'"  '; 
idt  'enter  (ext  (I),  JJ+I,  e?rr )'"  if  nome  not  there,  put  in 

'cop  ("value  call",  volue  (LL))  generate  a  fetch  request  111 
nm  *  numb  (ext  (I  ))  '"generote  o  literal  for  a  number1"  '  ; 
op  *-  *  sop  (ext  (I+l)  '"pick  up  ond  output  operotor  from  external  name  '"  '; 
unsum*-if  ext  (T)  =  then  sop  (un  min)  else'  "'unary  minus'" 
assign*-enter  (ext  (i),  JJ+I,  error)  '"if  name  not  there  put  in'"; 

cop  ("name  call"  value  (LL))  "'generate  an  address  request'""; 
sop  (%-")  '"generate  a  store  comrmnd'"  '); 


'"The  compiler  for  FLEX  itself  is  a  good  example' 


l 


I 
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flex«-scribe  "  metas  «-  (body,  list,  stat,  selr,  prim,  labl,  svar,  var, 

expr,  factor,  term,  arit,  rexp,  rtenm,  aterm, 
andl,  oterm,  orl,  bool,  assert,  utm,  uex,  ifcl 
trupart,  aop,  mop,  rel,  lop,  asop,  bup,  unop, 
iter,  sop,  set); 


'  T,  (begin,  "("),  (end,  ")"), 

"C",  "]",  new,  if,  then,  else, 

com,  unop*~  (scribe,  type,  (  "p,  ceil),  ("J",  floor), 

sin,  cos,  atan,  "I",  abs,  rand,  prand,  hash,  exp. 

In,  sort,  length),  "f ",  aop-«-("+",  "-"),  mop-*- 

"~Ymod), rel.*- ">", 

V>#  "A",  "V",  lop^-CV",  '>"),  sop-»- 
fn",  V,  "C"),  asop (is,  isn,  "6",  "$"),  of, 
while,  to,  by, .do,  ‘bo",  "il",  tops «*-( bop,  u0p, 
val,  map),  ident-*-(array,  field,  act,  leave,  term, 
xin,  yin,  plst,  plpt,  plln,  control),  (goto,  go),  (“V", 
"any"),  ar’M".*-",  as  )); 


syntax  ♦-P"  patterns...  I 


1 

A 

head: 

1  body 

it  ^  n 

bod: 

1  body  ^ — 

body  new 

empt: 

1  body  ■*— 

body 

1  body  •*— 

body 

1  body  *— 

body  end 

1  stat  •*— 

body 

1  selr  •*- 

body 

semantic  field,  scan 

field,  jump  field  , 

error  field  1'" 

,  scan 

,  go  head  , 

1; 

quot 

z  scan 

,  go  bod  , 

errl  1; 

new 

z  scan2 

,  go  decl  , 

1; 

,  scan 

,  go  empt  , 

1; 

coml 

,  scan 

,  go  empt  , 

1; 

endl 

,  scan 

,  go  lis  , 

1; 

equotl 

,  scan 

,  go  sta  , 

1; 

esell 

i  scan 

,  go  sel  , 

1; 
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atoms:  I 

body  -4 — 

n{ii 

i 

quot 

/scon* 

»go  bod. 

1, 

1 

body  4 — 

begin 

i 

/Scan 

,go  bod. 

1, 

1 

prim  4— ■ 

lit 

i 

push  1 

z  scan 

,go  pri. 

1/ 

1 

prim  4— 

"A" 

i 

pushl 

/scan 

,go  pri. 

1; 

prim  4— 

V 

i 

pushl 

,scan 

»go  pri, 

1; 

prim  4— 

ii  y  n 

i 

pushl 

/Scan 

,go  pri. 

1; 

if 

i 

/scan 

,go  atoms. 

1; 

while 

i 

,scan 

,go  atoms. 

1; 

com 

i 

,scan 

,go  atoms. 

1; 

unop 

i 

/Scan 

,go  atoms. 

1; 

asp 

i 

,scan 

,ga  atoms. 

1; 

goto 

i 

,scan 

,go  atoms. 

1; 

next:  | 

lob!  4- 

A 

i 

,scan 

,go  next. 

1; 

ident 

II.  II 

i 

label 

,scon 

,  go  otoms. 

b 

svar  4— 

ident 

A 

i 

nops 

f 

,go  sur. 

l; 

decl:  1 

svar  4- 

tops 

ident 

i 

tps 

/scon 

/  go  sur,  err2 

1; 

body  4- 

body 

ident 

n  n 
/ 

i 

decll 

/Scon2 

,go  decl. 

1; 

body  4 — 

body 

ident 

rt.ii 

/ 

i 

decl2 

/scan 

,go  empt,  err3 

1; 

svr:  1 

body  4. 

begin 

i 

/scan 

,go  bod. 

1; 

mbr:  1 

body  4- 

ii£ii 

i 

,scan 

,go  bod. 

1; 

vor  4— 

svar 

A 

i 

/ 

/go  vr. 

1; 

prim  4- 

var 

ar 

/scan 

,go  atoms. 

1; 

var 

A 

i 

i 

/ 

/go  pri, 

1; 

pri;  1 

1 

prim  4- 

unop 

prim 

A 

i 

unop 

/ 

/go  pri, 

1; 

1 

1 

expr  4-prim 

com 

prim 

A 

i 

popl 

/ 

,go  exp. 

1; 

1 

1 

expr  4- 

com 

prim 

A 

i 

uncom 

/ 

/go  exp. 

l; 

1 

prim 

com 

i 

/Scan 

,go  otoms. 

1; 
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1 

prim 

"f  " 

r  scan 

i  go 

otoms 

t  • 

|  prim  4- prim 

II  A  II  . 

T  pnm 

A 

popl 

r 

i? 

prl 

,1; 

|  foctor  4- 

prim 

A 

r 

95 

fact 

,1; 

tect:  |  term  4- term 

mop  factor  A  | 

popl 

r 

go 

trm 

,1; 

1  term*— 

foctor  A  | 

r 

§2 

trm 

,1; 

trm:  | 

term 

mop  | 

,  scan 

§2 

otoms 

,1; 

|  orlt  *-arlt 

a °P  term 

A  • 

popl 

r 

22 

ort 

,1; 

|  arit  4- 

aop  term 

A  1 

unmin 

t 

22 

art 

,1; 

|  arit  4- 

term 

A  1 

r 

22 

o  rt 

,1; 

ort  | 

arit 

aop  | 

,  scan 

22 

otoms 

,1; 

|  rexp*- rterm 

rel  orit 

A  1 

popl 

r 

go 

rxp 

,1; 

|  rterm  -4— 

orit 

A  1 

r 

go 

rtm 

,1; 

rtm:  | 

rterm 

rel  | 

f  scan 

22 

otoms 

,1; 

|  rexp  *_ 

rterm 

A  1 

r 

go 

rxp 

,1; 

rxp:  |  oterm  4- 

rxp 

"A"  1 

mark 

/  scan 

go 

otoms 

,1; 

|  ondl  4— 

rxp 

A  1 

fill 

go 

onl 

,1; 

onl:  |  ondl  4— 

oterm  ond  1 

A  ' 

/ 

22 

onl 

,1; 

|  oterm  *— 

and  1 

V  1 

mark 

,  scan 

22 

atoms 

,1; 

|  orl  *— 

and  1 

A  ' 

fill 

f 

22 

Ol 

,1; 

Ol:  |  orl  4— 

oterm  or  1 

A  1 

f 

22 

Ol 

J; 

|  bool  4— 

bool  lop  or 

1  A  1 

popl 

f 

go 

bl 

,1; 

|  bool  4— 

or 

1  A  1 

r 

22 

bl 

,1; 

bl:  | 

bool 

lop  | 

,  scan 

go 

otoms 

,1; 

|  set  4—  set 

sop  bool 

A  1 

popl 

9 

22 

st 

,1; 

1  set  4- 

bool 

A  1 

r 

22 

St 

,1; 

st:  | 

set 

sop  | 

/scan 

22 

otoms 

,1 ; 

1 

set 

osop  | 

/  scan 

go 

otoms 

,1; 

|  ossert*-set 

osop  set 

A  1 

osop 

r 

go 

ost 

,1; 
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|  utm«*-assert  of 

set 

A 

i 

/ 

,go 

ut 

/ 

|  utm  <— 

set 

A 

i 

/ 

,go 

ut 

/ 

ast: 

1 

assert 

of 

1 

,  scan 

,go 

atoms 

,  err4 

ut: 

|  uex-4-uex  bup 

utm 

A 

|  pop  1 

/ 

,/g£ 

ve 

/ 

|  uex4- 

utm 

A 

1 

/ 

#go 

ve 

f 

ve: 

1 

vex 

bop 

1 

,  scan 

/go 

atoms 

J 

|  expr-t-expr 

vex 

A 

1  pop  1 

/ 

/go 

exp 

t 

1  expr  4- 

vex 

A 

1 

/ 

'S° 

exp 

f 

exp: 

1 

expr 

1 

,  scan 

/.go 

atoms 

r 

|  stat  4— 

expr 

A 

1 

/ 

'£?_ 

sta 

,  err  5 

sta: 

1  stat-*-var 

ar 

stat 

A 

1  pop  1 

/ 

/go 

sta 

1 

|  stat  4- 

labl 

stat 

A 

1 

t 

/go 

sta 

/ 

1  stat  4- 

trupart 

stat 

A 

1  fill 

/ 

/g£ 

sta 

f 

|  stat  4- 

gots 

stat 

A 

1  unop 

/ 

/go 

sto 

/ 

|  stat  4- 

iter 

stat 

A 

|  itr 

/ 

/go. 

sta 

f 

|  if  cl  4- 

if 

stat 

then 

^  mark 

,  scan 

/go 

atoms 

t 

|  trupart  ->*- 

-  if  cl 

stat 

else 

|  els 

,  scan 

/go 

atoms 

/ 

|  iter  -4- 

while 

stat 

do 

|  whl 

,  scan 

/go 

atoms 

/ 

|  body  -4- 

body 

stat 

ii  ii 

t 

|  com  2 

,  scon 

/go 

empt 

r 

|  body  4— 

body 

stat 

ii,  ii 
r 

|  cln  2 

,  scan 

/go 

empt 

f 

|  list  -4— 

body 

stat 

end 

j  end 

,  scon 

,go 

lis 

/ 

|  stat  -4— 

body 

stat 

|  equot 

,  scan 

/go 

sta 

/ 

|  sclr  -4- 

body 

stat 

"J" 

|  esel 

,  scan 

/go 

sel 

,  err  6 

lis: 

|  svar  -4- 

svar 

list 

A 

1 

/ 

/go 

sur 

/ 

1  svar  -4— 

list 

A 

1 

/ 

i  9£ 

mbr 

r 

oel: 

|  svar  4— 

svar 

scln 

A 

l 

r 

,go 

svr 

,  err7 
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IV*  The  User's  Environment 
Introduction 

Most  interactive  systems  use  a  special  command  language 
for  handling  files,  initiating  jobs  and  communicating  with 
the  compilers.  In  the  FLEX  system  this  language  is  FLEX— 
no  other  languages  need  be  learned.  There  are  also  no 

special  entities  called  -files"  in  the  system  as  will  be 
seen . 


Admitting  the  User  to  the  Machine 

When  it  is  desired  to  allow  a  new  user  access  to  the 
machine,  a  process  is  created  and  named  with  his  password. 
This  process  will  not  terminate  during  the  period  that  he 
is  allowed  to  use  the  machine.  Most  of  the  time  it  will 
lie  Passive  on  the  secondary  storage  waiting  to  be 
reactivated  which  is  simply  done  by  the  user  typing  in 
his  password  on  the  console. 

The  user's  process  is  activated,  and  he  is  now  able 
to  communicate  with  the  machine  through  FLEX  and  the 
powerful  editor  which  controls  a  free-running  compiler  that 
is  translating  everything  that  is  entered  through  the 
keyboard  to  FLEX  code.  Since  his  process  is  also  declared 
££tive,  the  pragmatic  system  will  attempt  to  execute  all 
produced  code.  This  will  appear  to  the  user  as  though  his 

comiriands  at  this  lowest  level  are  being  executed  statement 
by  statement. 


'•wwKa 


By  these  means  the  user  may  entertain  himself  by 
performing  calculations,  editing  text,  generating  new 
compilers,  and  generally  going  where  his  thoughts  lead 
him.  When  he  desires  to  cease  running,  he  simply  types  in 
a  -*-eave •  This  is  the  coroutine  exit  command  and,  since 
the  routine  which  called  him  is  the  process  scheduler 
itself,  his  process  is  passivated  and  the  reentry  point 
retained . 

On-  the  next  day  (or  next  week)  when  he  again  types, 
m  his  password,  his  process  is  reactivated  and  control  is 
passed  to  the  reentry  point;  he  is  where  he  was  the  last 
time  on  the  machine.  This  is  why  files  (and  file  handling 
systems)  are  unnecessary  on  the  FLEX  machine.  Any  declara¬ 
tions  he  may  have  made  (and  possibly  stored  data  in) , 
have  been  saved  to  be  used  again. 

Scope  of  the  User 

The  user  at  the  console  is  considered  to  be  inside  a 
process  description  which  m  turn  is  interior  to  the  FLEX 
system  and  environment.  This  concept  of  system  globality 
fits  well  the  FLEX  philosophy  and  provides  a  convenient 
mean-6  of  allowing  the  user  access  to  entities  such  as  the 
FLEX  language  tables  themselves,  reserved  identifiers 
whose  meaning  he  may  wish  to  redefine,  etc. 


v. 


Th e  P  tag ma  t 1  c  Knvi 3; onm=an  L 
!.  ,  Inti ociuot.ion 

In  tius  chapt o.v  we  r  1  ust  f^un-ide r  th r  problems  of 
physically  realizing  the  p’  1  Icuoohico.  p  - one ’-dud  in  the 
pi « v  1  o as  sect  1 0 ns. 

There  have  been  numcron  app  ■  oacboi:  to  solving  fh  1  s 


pr  ob  !  era;  some  successful  ,  many  more-  unsucc^p.-'f  1; !  ,  I'yiss#  t  er 
pi  og  r  arm;  m  general  also  seam  to  wur'i;  according  to  the  ■ 

;.;rmu:  ratio. 

One  hot.  1  Leneck  is  tno  ai  t-  mpt  to  "do  u.!  I  things  for.  all 
people  ' ;  another  in  to  try  to >  make  the  program  work  at 
100%  efficiency  100%  of  the  Lime.  The  fust  method 
u  s  u  b  '  ‘  V  entails  1 1  u g  e  ,  u  niuu  j  1  o  ••  .j  e  u  I  >  i  e  pi  o  g  r  a  m  s  ;  t  h  e  s  e  c  o  n  d 
means  that  much  fast  hardware  will  have  to  ne  used. 

The  FLEX  environment  on  the  object  machine  takes  a 
different  tack.  First,  the  machine  structure  may  be  designed 
so  that.  it.  is  compatible  both  with  the  language  tnau  will 
bs  executed  and  with  the  problems  that  w.i  .1  j.  be  solved. 

Second ,  a  statistical  viewpoint  is  adopted.  For  almost, 
ai.!.  computer  problems  in  general,  on  any  machine  (and  in 
pa;  tie  u.d  r  those  problems  tor  which  the  obiect.  machine  is 
1  f“:  •*  ne  i  thei  1 0  0  t  et  f  ic.i  ency  100%  of.  the  time  nor 
b  1  inu  u  iij  » peed  1  s  necessary.  Fat  tunately  from  the  software 
P°int  1  icw,  the  ,t  i  r  st.  is  not  needed  and  thankfully,  for 
the  price  tag,  neither  is  t.he  second. 
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The  environment  seeks  to  keep  the  overheads  to  a 
minimum  for  things  that  are  done  90—98%  of  the  time. 

This  means  that  most  of  the  time  the  machine  will  act  as 
though  it  were  far  larger  and  faster  than  it  actually  is. 
Witness  some  statistics  from  Stanford  where  a  Burroughs 
B-5000,  a  machine  suited  for  algorithmic  languages,  actueilly 
ran  most  problems  faster  than  an  IBM  7090— a  machine  whose 
hardware  was  significantly  faster  than  the  B-5000. 

Of  course,  occasionally,  the  piper  must  be  paid.  The 
FLEX  system  seeks  a  graceful  degradation  m  performance 
as  the  load  goes  up.  The  machine  simply  appears  to  slow 
down.  When  there  are  too  many  active  segments  or  numerous 
quite  large  segments  in  core  memory,  an  increasing  burden 
is  put  on  the  secondary  storage.  Where,  most  of  the  time, 
the  cheap  secondary  storage  allows  the  machine  to  look 
as  though  it  had  a  large  core  memory,  now  saturation  will 
force  operating  speeds  to  approach  the  speed  of  the 
secondary  storage  rather  than  that  of  the  primary. 

Another  interesting  consequence  of  this  point  of  view 
is  that  the  environment  works  quite  independently  of  the 
particular  storage  limitations  and  conversely  the  efficiency 
of  the  machine  depends  very  much  on  these  same  limitations. 


What,  dfofts  this  muuf; : 


Ideal  ‘-k'lchiiit 


performance 


\8k  \  IV 


\  \ 

\  \  V“ 
V  ^*v 


&  of  time. 


1 t  means  that  foi  uso-  i  •  .  n  ,n  t.  ; 

- •  -  '  increase  m  memory 

o.«.ze  will  mot  clrast.iea.ly  improve  performance,  but  it 
will  dramatically  reduce  the  percent  of  time  spent  i.n 
overhead  when  the  system  becomes  clogged. 

it  also  ra#*ns  that  th -  physical  system  may  be  expanded 
or  reduced  without  routine?  ad;) uatnient  of  programs--*  hand* 
-vature.  Moot  programs  ■  -J  J  :  nt  run  any  differently  with 
*“  1,w3rw*'5!*  ln  11  run  significantly  better; 


axiil  £w«*  will  confirm,--  :•  i-h(> 


Reproduced  from 
best  available  copy. 


2 .  Segment  and  Process  Control 
a .  Segments 

In  the  FLEX  operating  environment  the  basic  logical 
structure  and  the  basic  physical  structure  are  one  and  the 
same:  The  segment.  Logically,  the  segment  is  a  contiguous 
string  of  16-bit  words  in  core  memory  and  secondary  storage 
whose  length  may  be  changed  with  varying  degrees  of 
effort. 

Addressing  in  the  system  is  relative  to  the  segment 
ngt  to  any  particular  memory  location  so  that  a  particular 
segment  may  be  moved  anywhere  without  disturbing  access 
to  it. 


segment  |  displacement- 


Typical  Segment  Address 
Cord'  Memory 

High  speed  memory  initially  consists  of  one  segment  called 
garbage .  All  other  segments  in  the  system  are  created  by 
portioning  the  garbage.  An  attempt  is  made  by  the  system 
to  intersperse  garbage  segments  between  active  segments. 

This  allows  some  expansion  without  rearrangement  of  other 
•segments.  This  strategy ,  will  work  well  with  relatively 
static  entities  like  process  descriptions  (code),  and 
arrays.  Process  stacks  are  another  matter  and  some 
shuffling  is  required. 

t:  • 


\ 
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garbage 


//////."///////.V 

7/////////////// 

////////////.V// 


'*///////////////, 

'///////////////// 

'////////////////, 

seqment  4 

segment  1 

rrrrrf  /  rr  >  tffffrt* 

///////////I////. 

seamenr  1 

'////////'//////// 
'////////////////* 
'////////////////  / 

seqment  l 

segment  2 

777777 77  ;;; 

segment  3 

Segment  Allocation  in  Core  Storage 

At  this  point  paging  she  lid  be  considered.  With 
paging,  the  logical  entity  (variable  length  segments) 
would  be  made  up  of  one  or  more  pages  of  some  fixed  size. 
Paging  has  some  advantages  in  that  reclamation  of  garbage 
and  transfer  to  secondary  storage  is  made  easier.  The 
disadvantages,  however,  outweigh  the  advantages  for  the 
address  path  is  more  complicated  requiring  two  table 
lookups  rather  than  one. 


segment  |  page  |  displacement 


Typical  Paged  Address 

In  keeping  with  the  strategy  of  optimizing  most  used 
operations  (and  accessing  memory  is  certainly  at  the  top 
of  the  list) ,  while  allowing  a  certain  amount  of  dirty 
work  a  small  percentage  of  the  time,  paging  is  rejected 
as  too  expensive  for  every  access.  Accordingly,  segments 
are  mapped  contiguously  and  memory  must  be  reordered  when 
segment  threatens  to  overrun  another. 


one 


^'f'rrr///////// 

segment  2 

prv  >  >  >  }  >  >  ,  ,  7  }  f  ,  ,  , 

segment  I 
growing  segmem 


segment  1  * 

segment  2 

^77 7y7T77T7r77TTT 

remapping  segment 


segment  2 


segment  1 
reclaiming  garbage 


There  are  several  ways  to  remap  segments.  The  cheapest 
is  to  find  a  large  enough  area  of  garbage  and  reallocate 
the  segment.  if  this  cannot  be  done,  then  garbage  must  be 
collected  and  arranged  to  form  a  large  contiguous  free 

space  which  may  then  be  used  for  allocation  and  new  segment 
creation . 

If  no  garbage  is  available  then  some  must  be  created  by 
transferring  one  or  more  active  segments  to  secondary 
storage.  This  operation  is  usually  called  swapping.  if 
there  are  many  segments  in  the  system,  but  only  a  few  are 
used  at  any  one  time,  then  the  swapping  overhead  will  be 
low  and  the  machine  will  act  as  though  its  usable  core 
memory  is  much  longer.  If  there  are  many  segments,  and 
many  are  accessed,  then  a  system  clog  is  created,  and  the 
apparent  access  time  becomes  longer. 

In  all  cases  when  a  segment  is  expanded,  it  is  not 
lengthened  by  just  one  word  but  by  a  number  of  words  equal 
ro  some  fraction  of  its  current  length.  This  allows  some 
room  for  further  expansion  without  disturbing  the  system. 
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be  c  °  £Ld  a  1  v  Mem  o  r^ 

As  i t  as  pseudo-random  in  nature,  secondary  memory  is 

handled  xn  a  .similar  manner.  The  scale  is  larger,  the  time 
slower,  the  intervals  between  garbage  collection  longer. 
Once  a  segment  is  swapped  out  it  will  remain  in  the 
a e e o nd a x y  * memo r y  until  an  access  is  requested. 

Wc-  uow  liave  LiVi  Sc*!n'-  problem  that  was'  presented  to  us  " 
in  core:  garbage  must;  be  found  to  accommodate  the  segment 
being  swapped  ui  Again  it  no  garbage  can  be  found  (or  ^ 

mane),  ii  must,  oe  created  by  first  swapping  out  one  or 
more  active  segments.  Then  the  access-request  may  be 
swapped  n  ,  • 

.the  l  cd  Jiza  t  j  on  ot  these  algorithms  will  be  presented 

dfiei  process  control  is  discussed  since  both  operations  are 
Inter t w i ned . 

k  •  P£oc e as  Con  t r  o  J. 

The  basic  data  structure  has  been  discussed— now  the 
basic  execution  entity  will  be  covered:  the  process . 
Definition  of  Terms 

A  P£££ess^scrijjLion  is  a  segment  that  contains 
executable  code  generated  by  the  compiler.  By  its  very 
na  ur e  this  code  is  reentrant,  which  means  that  it  does 

n  >t  modify  itself  and  therefore  may  be  in  several  stages 
of  execution  a t  a 


given  time. 
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A  process  is  just  an  instance  of  execution  of  a  process 
description;  there  may  be  more  than  one  process  in 
existence  at  one  time  for  a  given  process  description. 

Parallel  processes  are  required  for  operation  of  the 
system.  The  I/O,  the  display,  the  keyboard,  the  compiler, 
etc.,. must  be  able  to  run  concurrently  with  the  user’s, 
.programs  and  with  themselves.  Moreover,  the  compiler 
which  is  inceracting  with  the  user  at  the  keyboard  may 
have  to  run  in  parallel  with  a  logical  "copy"  of  itself 
executing  the  com  operator  in  a  user  program. 

Since  this  mechanism  is  needed  it  is  no  trick  to  allow 
the  user  in  FLEX  to  create  concurrent  processes  of  his 
own- -a 1 i  handled  by  the  same  algorithms. 

This  ability  is  literally  invaluable  for  all  kinds 
of  programming,  recursion,  and  event-oriented  simulation — 
a  pnrife  use  for  the  MM-8000. 

Process  Creation 

The  basic  idea  is  simple.  Since  the  process  description 
(the  code)  does  not  modify  itself,  it  can  contain  no  data. 
Therefore,  it  must  have  some  way  of  accessing  data  which  is 
independent  of  itse 

Lin  t  n 
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Prooesa  Description  with  Two  Seta  of  .Bata 

One  way  this  has  been  done  in  conventional  machines  is 
to  create  a  separate  data  area  for  each  process  and  to  force 
the  process  description  to  access  all  its,  data  through 
a  base  register  which  contain  the  low  order* address  of  the 
desired  data*  Now  the  process  description  may  be  switched 
from  one  process  (the  handling  of  data  A)  to  another  (the 
handling  of  data  B)  with  ease  provided,  the  reentry  point 
of  each  process  is  retained  while  the  other  is  being 
executed. 


To  effectively  run  the  two  processes  in  parallel,  a 
fixed  time  of  execution  may  be  assigned  to  one  process 
before  the  other  one  must  be  started  up.  This  ia  the 
HiJES.  and  typically  is  about  10  ms. 


It  is  not  difficult  to  generalize  this  idea  to  the 
PLE-a  environment  and  the  segment  system. 

~ eruption  is  a  segment.  Each  data 


area  becomes  segment  and  the  base  register  refers  to  the 
data  segment  name.  The  reentry  points  may  become  p&rt  of 
uu.i.t  <-oSociated  data.  All  that  remains  is  to  formulate 


a  scheme  for  scheduling  the  execution  of  each  process.  A 
simple  list  containing  the  process  names  which  is  visited 
round-’  obm"  fashion  every  16  ms  will  do. 


**  r 

/  b 


FLFX  Pr  .vjj s  Coot ro  1 

he  figure  shows  the  system  about  to  execute  B.  This 
c..  i  eel  ■:s-.iv-.,tioii<  Do.'  j  ny  execution,  process  B  is  said 
'  o  e.  f.xvo  and  cue  per  1  ori  during  the  duration  of  B's 
f,.nc  quantum  is  said  to  be  an  event  of  B.  All  entities 
:  n  4  he  figure  are  segnv  •  - 1  ,  and  thus  may  be  swapped, 
ho  f'S_  .itack 

Because  of  the  we.l  i-nes*  ed  properties  ot  algorithmic 
.  in-.iaur..-  :.p  general ,  anct  FLAX  in  particular,  the  data  for 
a  r.  jl  -  -  -  as  is  an  extendable  ogment  sailed  a  pr  oce os  stack . 
S1  "'if.  information  which  is  necessary  for  each  event  is 
ratified  m  the  base  of.  t.ne  »,.ac.kf  such  as  the  process 
description  name  and  t.!\e  1 1  entry  point  associated  with  it. 

ivii  ic  if  is  having  ov'-nt  ,  the  ether  processes  are 
Said  to  Iv  pa s s i v e .  when  the  process  stack  is  collapsed 
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and  the  process  name  is  removed  from  the  event  list, 

... 

the  process  is  said  to  be  terminated. 

.  - -  1  1 '  1  ni"  "  1  " 

Passivation 

T  c  .  < . 

A  process  may  be  made  passive  by  more  than  just  the 
ending  of  an  event.  In  general,  when  a  process  initiates 

'  :  !  "*  .  i  ;  } 

an  I/O  operation,  it  will  be  passivated  while  the  I/O 
is  running. 

'  •'  •  *  *  •  ■  1  ■>  $  *:  •  ,v  ‘  ;  ■./■ 1  < 

Indeed,  all  the  real-time  processes  such  as  the  I/O, 

■  “■  '  .  ■  c v  ;  _  ’  •.  . 

the  display,  the  keyboard  handler,'  etc,,  because  they 

i  •  .  •  .  i  t  ■  V 

cannot  wait  when  something  that  involves  them  is  happening, 
have  the  ability  to  pass lvate  (or  interrupt)  any  other: 
process  and  to  activate  themselves. 

The  round-robin  algorithm  must  be  modified  slightly 
to  accommodate  the  real-time  processes. 


Event  List 
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All  Lhe  real-time  event  notices  are  logically 
clustered.  Between  each  event  they  are  scanned  by  the 
scheduler  to  see  it  act:  va!ion  is  required.  If  not,  the 
process  pointed  to  by  the  current-event  pointer  is  activated,- 
At  any  time-  an  outside  rni.'tr.tpt  may  point  into  the  real- 
time  area.  When  this  happens,  the  current  event  is  passi- 
v a ted  and  the  real-time  event  activated. 

A  FORTRAN  or  ALGOL  program  consists  of  just  one 
process  and  so  do  many  programs  m  FLEX.  Therefore  process . 
hand  liny  and  access  should  bo  optimized.  This  is  accomplished 
by  filtering  every  request  to  memory  through  one  of  four 
base  registers.  Since  the  rearrangement  of  memory  requires 

an  ,'"e  garbage  process,  during  an  event,  core 

memory  is  still  and  the  base  registers  may  contain 
absolute  addresses.  These  addresses  are  calculated'  during  •  • 
an  activation  and  are  the  only  contact  with  absolute  address 
that  the  entire  system  has.  (Excluding  the  garbage 
collector,  of  course.) 

Base  Registers 

During  an  event  one  base  register  is  free  for  system 
use.  Another  holds  the  base  address  of  the  process 
description;  the  next  contains  the  base  address  for  the 
process  stack.  The  .last,  as  will  be  seen  later,  will  aid 
m  accessing  other  segments. 


has  effectively  dene  away  with  direct  addressing  and 
introduced  relative  '.and  moveable)  data  entities  in  the 
segmenting  scheme  .  t  i.ngs  actually  hold  still  for  the  major 
part  of  the  time  and  die  basic  overhead  during  an  event 
is  a  short  add  whose  time  will  be  absorbed  by  the  micro 
code  hardware. 

Data  Segments  Associated  wi th  a  Process  Stack 

The  exact  format  of  a  process-stack  will  be  discussed 
in  the  next  section  or  execution  .  Now  it  will  suffice  to 
say  that  each  slot  in  ; he  process  stack  is  associated 
with  a  different  vari ..  ie  name  in  FLEX.  During  compilation 
a  variable  name  in  tn  s  formed  to  a  relative  index  in  the 
stack.  The  slot  tse  '  may  hold  a  number  05:  a  pointer  (called 
a  descriptor)  . 
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If  the  variable  remains  unmapped  and  contains  only 
r' number s>  then  this  data  may  be  accessed  directly  with 
no  overhead.  if,  however,  a  <list>,  any  other,  entity, 

t 

or  a  map  is  assigned  to  the  variable  then  the  data  is  • 
put  in  a  fresh  segment  and  a  descriptor  is  created 
containing  the  new  segment  name  and  a  description  of  the 
data.  The  descriptor  is  stored  in  the'  slot  and  is  effe- 
tiveiy  a  self-typed  indirect  address. 


Example : 

'new  a,b,c 


a-1 .  ; 

b” (3,4,5)  1  ; 


num 

” 

data 

3 

jname 

num 

1.0 

P.D. 

re¬ 

entry 

process  stack 


num 

r*' 

5.0 

num 

4.0 

num 

3.0 

segment  ' namel' 


Program  and  Realizati on  (Schema tic) 

The  slots  are  created  in  order  and  are  initially  set 
to  ft.  'a'  contains  a  1.0  while  ' b '  contains  a  descriptor 
which  effectively  points  to  the  freshly  created  segment 
name  1'.  Or  course,  the  data  descriptor  m  "I"  cannot 


eemta  Ln  the  absolute  address  f 'or  ■  dime  l-1  b&douse  'name  lr 
.va.'  v  have  ku.u  rated  to  secondary  storage  during  some  other 
p.  ocsssf-fi  event..  So  it  must  contain  a  name  for  the  segment 
and  the  absolute  address  at  any  given  time  must.  be  looked  up.. 
Unidue  names  i or  freshly-created  segments  are  doled 
it  by  a  system  routine  and  consist  simply  of  a  12-16  bit- 
integer  . 

The  Gogmcn t  Assocxa cion  Table 

The  operation  tha  -  needs  to  be  performed  }.-s  the  same 
;jy  the  associative  operations  m  FLEX  and  the  same 
mechanisms  and  formats  are  used.  Wien  a  segment  is  greated 
or  brought  into  core  storage,  we  wish  to  form  an  association 
thus*.;  loo  is  base  address  of  seg-name; 

The  inverse  operation  needs  to  be  performed  when  the 
augment  is  accessed:  ?  is  Base-address  of  seg-name; 

This  will  return  the  absolute  location  of  the  segment 
Winch  will  be  placed  in  the  fourth  base  register  and  then 
used.  When  a  segment  is  swapped  out  or  destroyed,  the 
association  needs  to  bo  removed:  ?  isn  basehaddress  of 


seg-name; 

If  the  association. fails ,  then  the 
on  the  secondary  storage  and  a  somewhat 
g;«t) tch  may  be  made  to  find  it  and  bring 


segment  is  residing 
more  leisurely 
it  into  the  core 


memory . 
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The  Association  Struct are 

This  will  be  covered  „,n  great  detail  in  the  next 
section  on  execution,  nut  the  operation  may  be- demonstrated 
schematically  *  Of  course,  the  table  itself  is  a  segment 
and  has  a  logical  format:  s  shown: 


a  bo 

link  add 


free  expi,.:..  .  -nd 
The  Segment  Table 


Associative  hard  w  .  ■ 
it.  cannot;  be  used  to  r  \ 
and  others  [8]  have  sh 
stimulate  an  associate  n 


prohibitively  expensive,  so 
the  information.  Feldman  [7] 
r  hashing  may  be  used  to 
rery  effectively.  The  method 


tsed  j  s  similar  to  thar 
teclmique  is  derived  t  i  ■: 


TP  19 i,  although  the  hashing 
different  source. 
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The  name,  a  12-16  bit  number,  is  reduced  by  the  hash 
to  a  4,5,  or  6  bit  number  which  is  used  as  an  index  to 
search  the  table.  Since  not  even  the  best  hashing 
algorithm  can  totally  eliminate  the.  possibility  of  two 
names  hashing  to  the  same  place  (as  'name  1*  and  ’name  2’ 
have  done)  provisions  must  be  made  for  this  eventuality.  1 
.  After  the  index  selects  a  row,  a  comparison  must  be 

made. to  see  if  we  have  uniqueness.  If  we  do  (percentage 
dependent  on  the  hash  size) ,  then  the  absolute  address 
may  be  delivered  without  further  ado.  If  the  name  column 
contains  a  zero,  then  there  is  nothing  in  core  memory  that 
hashes  to  this  slot,  and  the  segment  must  be  out  on 
secondary  storage.  The  same  applies  to  the  case  where  the 
comparison  fails  and  the  link  field  is  zero  indicating 
a  chain  is  piresent.  The  overhead  for  a  good  hit  is  2  650 
us  memory  cycles.  That  for  a  fault  is  1  or  2  650  u$ 

: memory  cycles. 

Now  the  high  overhead  case  is  considered.  If  the 
absolute  address  of  'name  2'  is  required,  a  chain  of 
mult  ip/1  e  hits  must  be  followed.  Fortunately,  this  does 
not  happen  very  often. 

In  all  the  associative  structures  the  percentage  of 
multiple  hits  is  calculated.  2-4%  is  the  maximum  allowable 
level;  when  this  is  exceeded,  the  associations  are 


recalculated  for  a  larger  sihlng  areu  wMoh  pulls  the 
multiple  hits  down  to  a  r*a-  level,, 

This  scheme  foXXawo  ,:iu  philosophy  of  the  FLEX 
environment.  Most  of  th  .Line,  it  looks  like  something 
much  better  than  it:  in  :  associative  memory  1  For  2-4% 

of  che  time  it  looks  J  ist-proc<  ssing  table.  .  / 

Segment  Creation 

A  segment  is  croa  converting  «.n  area  of  garbage 

tnto  active  storage  f  or  this  :  egment  must  be  found 

and  entered  into  the  s-  ■  table. 

Since  creation  and  ...  ruction  art:  dynamic ,  a  way 
inuia c  be  found  to  maxima.!  i i i t e  t'.i;  ; ^ i . t  j_  number  of 

segment  names  available  ,  could  bo  done  by  maintaining 

a  pool  of  unused  names  .i  n  in.:  to  provide  a  new,  unique 
label  for  a  segment- -but  r  ;n  ■.  3  ys  costiy  in  terms  of 
storage,  sc  a  different  c  uh  is  taken. 

When  it  is  desired  create  a  segment,  garbage  is 
found  (or  made)  in  the  .r-.ua  i  way .  The  machine  contains 
“  random  nurooer  genera:  w.:nch  is  used  to  select  a  name. 

Ar.  access  reefuest^  for  name  is  then  made  to  see  whether 

or  not  that  number  is  a  ay  m  use  as  a  segment  name, 
if  it.  is,  a  new  random  .■  is  done  and  a  new  test  is 

made.  Very  rarely  wii  '  a  selected  name  oe  in  use,  so  the 
Igorithm  wiLl  almost  ,  s  wort  the  1.  .  ?  st  time 


Reproduced  from 
best  available  copy. 


r*  vtrwiv.fty  1 


The  new  name  may  then  be  entered  into  the  segment 
table  along  with  the  absolute  address  of  the  displayed 


84 


*  m 


garbage  and  segment  creation  is  accomplished. 

Criteria  for  swapping 

How  is  a  segment  picked  for  transfer  to  secondary 
storage  for  the  purpose  of  creating  garbage?  No  swapping 
algorithm  has  been  shown  to  be  really  satisfactory.  The 
one  presented  here  will  work  quite  well,  and  following  the 
FLEX  philosophy,  requires  no  bookkeeping  on  each  memory 
access . 

The  influence  of  the  compiler  extends  directly  down 
to  the  lowest  level  of  the  machine  and  provides  information 
that  is  not  commonly  available  on  other  machines.  Some 
of  this  information  has  to  do  with  an  insight  into  the  use 
to  which  eadh  segment  will  be  put  which  may  be  partially 
derived  from  mapping  conventions  and  process  use. 

The  volume  of  seqments  mapped  as  8-bit  bytes  (text) 
will  tend  to  be  high-~yet  use  is  limited  by  storage  dnd  \ 
display  restrictions.  One  might  hope  that  these  segments 
will  migrate  to  secondary  storage  in  a  fairly  rapid  manner. 

General  data  segments  have  a  somewhat  higher  priority — 
yet  they  are  clearly  the  next  level  to  be  thrown  out. 

Process  descriptions  and  process  stacks  certainly 
have  a  higher  need  to  remain  in  primary  storage  in  order 

to  sustain  a  rich  amount  of  process  activity. 

I  *■ 

'V  '  jr‘ 
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The  real-time  processes,  the  event  list,  the  segment 
table,  and  other  system  entities  need  to  maintain  residency 
in  primary  storage  all  of  the  time.  Therefore,  they 
should  never  be  swapped. 


cr  2  o*  3  cr  4  cr 


Priority:  1234 

These  priorities  may  be  expressed  as  a  weighted 
conditional  probability  or  as  the  number  of  standard 
deviations  on  a  normal  curve. 

The  swapping  scheme  now  works  as  follows.  A  random 
number  is  selected  just  as  in  segment  creation.  This  is 
hashed  to  locate  a  slot  in  the  segment  table  and  thus, 
eventually ,  a  segment.  The  type  field  is  examined  for 
priority  and  a  question  is  asked  whose  answer  is 
weighted  towards  that  priority.  For  the  normal  curve 
weighting  scheme,  the  probability  of  a  yes  answer  to  the 
question:  "Should  this  segment  be  swapped?"  is: 

_ area  of  a  number _ 

total  area  of  a  curve 

If  the  segment  was  text,  then  it  would  have  a  57% 
probability  of  being  swapped  and  a  corresponding  33%  chance 


of  staying  in.  A  system  segment  (having. priority  4) 
will  have  a  zero  chance  of  being  swapped. 

Suppose  now  that  a  segment  is  in  heavy  use  and  is 
swapped.  Then  it  will  come  right  back  in--but  the  chance 
for  it  being  swapped  again  is  now  quite  small  since  a 
random  selection  is  used.  Conversely,  a  segment  in  little 
use  will  simply  remain  swapped. 

The  end  result  is  that  all  segments  in  primary  storage 
are  scrutinized  uniformly  and  those  that  are  active  tend 
to  remain  while  those  that  are  not  will  tend  '.toward 
secondary  storage. 


I?'1--  ■  c u ■  ion 
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i ,  hr oc63.;_  De:iOi  ipfcion 

A  pi  .  ss  description  it.  a  a&gmant  that  $my 
b  tie  hardwar-  ,.:f  the  ’  LEX  machine,  There  are  basically 
b  e  n  ndt  5i  *  c  res  coo  t  r  mod  in  this  segment.:  sia?gsl© 
■.  oti,  a  .o.t3,  compound  opoi  '■  iori3 ,  and  numeric  and  string 


t  e  i  i 


.1  ? 

•1  »  i 

J.  ± 

1  ;  1  ...  J. 

1  op  code  j  value  | 

n  imp 

L  sp  •  i  (jt  i.  ix .  ..  i  j 

ompound  opera  t.  :-r 

TbC  f.i 

r«:  i.ti ...  ir.  o. . 

so  dete.nni.nes  the  length  to  be 

■■  t  ■  i  t  ■  ■ 

)  1  s  ;t  I,,  i 

1  kh<*  FLEX  operators  axe 

<  --’ipi  i  >  -d  u 

s  mp?  j  •  •  oij. 

ho  i  urn<  3,  requests  for 

‘I  i.’i 

The  c.\  pot 

M'tpS  ,  ! "  .IC  r 

nd  re. 

'■■ound  operators  . 

op  code 

V  !  *  <  * 

irranifit} 

v.jjt  •  e  ail 

£  t-ci  t:  k  ’  •  ■■:.  [  r-:  / 

f  i. no  a  value,  pat  it  on  top 

;  .-1  c  a  o  k 

name  ca  t ; 

at  -ok  m  i  .  .. 

e;  e  te  a  da  -jcr  iptor  ,  put  it 
on  top  of  stack 

Jump  true 

a  ;  spAac-eme  n  t 

Jump  if  top  of  stack  true 

.:y«x  •  false 

dispirit'"© me  • '. 

Jump  if  top  of  stack  false 

J  urn  p 

d  .  t>  p  i.acem  a  a  r 

J  ump  vs  ncond  1 1 xona  1  ly 

/.  i  '3 

ftl.u'nta*- L  •.  v.t  f 

create  space 

Bill. 

number  o'  [,..j  ,■ 
me ei  s 

to  match  actual  with  formal 
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Recursion 

Recursion  is  easy  in  the  FLEX  environinent .  Each 
parent  process  simply  creates  a  pew  child  which  is  linked 
to  the  parent  by  the  returns.  The  |  call  j  operator  is 
used  so  that  just  one  instance  of  the  recursion  is  active 
at  any  one  time* 

Following  is  a  subroutine  which  calls  itself  for  , 
determining  the  factorial  of  a  number. 

fact  *-  'new  a.  if  a  -  1  then  1  else  a  *  fact  (a-1)  '  ; 
'“'This  creates  the  following  structures  when  activated  by 

the  next  statement''' 

display  ~  "fact  (3)  =  "#fact  (3); 
fact  (3 )  =  6.0 


parent 


N  j  3  • 1 
N I  3 


1st 

instance 


/A  . 

/ 

N  2_  U 

N  j  '*  2  i 


2nd 

instance 


All  returns  from  a  call  as  well  as  reactivating  the 
parent  process  also  transfer  the  top  element  in  t?he  stack 
from  the  returned  process  to  the  top  element  in  the  stack 
of  the  parent  process.  This  is  the  way  results  are  passed 
back  when  a  procedure  is  used  as  a  function. 
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Input/Output  Conventions 

I/O  Devices 

I/O  in  FLEX  does  not  require  anv  special  statements; 
it  is  handled  as  a  generalization  of  the  assignment 
statement.  How  is  this  realized  in  actuality? 

Each  device  has  a  reserved  variable  name  associated 
with  it  and,  hence,  there  also  exists  a  slot  in  a  process 
stack  somewhere  in  the  system  that  is  also  associated 
with  this  name.  This  process  stack  is  the  I/O  process 
s tack  and  is  pointed  to  by  the  "1/0"  event  request  in  the 
real-time  sectior  of  the  process  control  que. 


Line  Going  Out  . . . 


Card  Coming  In.  .  . 


I/O  Control 


An  I/O  interrupt  uses  the  number  of  the  device  that 
caused  it  as  an  index  into  the  I/O  process  stack.  In  the 
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slot  associated  with  the  device  there  is  either  an  ft 
or  a  data  descriptor  pointing  to  a  segment  which  contains 
data  to  go  out  or  data  coming  m.  The  figure  shows  an 
execution  of  the  statement: 

printer  2  *-  "al3  =  "  #  al3#  "  b22="#b22; 

Since  no  format  of  anv  kind  has  been  specified,  a 
FLEX  free-format  is  assumed.  As  the  concatenations  are 
executed,  a  scratch  segment  is  created  in  the  usual  way 
to  contain  the  generated  string.  When  the  is  executed 

it  first  looks  at  the  description  for  the  storand.  It  is 
marked  as  a  temporary  and  therefore  only  a  name  transfer 
is  needed  rather  than  a  copy.  This  is  done  into  the  slot 
m  the  I/O  process  stack  which  is  now  marked  active. 

Some  time  in  the  near  future  the  I/O  system  will 
deliver  an  interrupt  saying  that  printer  2  is  free.  The 
"printer  2"  device  number  un  this  case:  4)  finds  the 
data  description  m  the  stack  indicating  that  something  has 
to  go  out.  This  is  set  up  and  that  data  is  squirted  out 
on  the  channel  coax.  The  "printer  2"  slot  is  now  marked 
empty  and  life  goes  on  as  before. 

If  the  above  FLEX  statement  were  in  a  loop  for  printing 
out  consequently el y  generated  values  of  al3  and  B22,  it 
might  very  well  be  possible  that  another  "printer  2" 
assignment  might  be  made  before  the  previous  line  was 
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transferred  out,  The  answer  ^.s  simple.  if  the  "printer  2" 
slot  does  not  contain  an  then  the  current  process  is 
passivated  until  the  next  time  around  the  round-robin.  By 
then  the  line  may  or  may  not  have  gone  out  and  the 
algorithm  is  continued.  Eventually  the  line  will  be  printed 
and  the  current  "printer  2"  statement  will  be  executed. 
Naturally,  more  than  one  line  may  be  output  in  one  statement — 
a  vector  of  lines  may  be  assigned.  The  above  just  says 
that  an  I/O  statement  to  a  unit  must  be  physically  realized 
before  another  to  the  same  unit  may  be  made. 

Input  is  similar.  While  assignments  to  the  printer 
have  been  going  on,  the  card  reader  had  been  active.  An 
interrupt  occurred  saying  that  it  had  something  to  deliver. 

A  data  descrj  ptor  was  found  showing  a  read  request  (one  is 
always  there  for  pure  input  devices)  and  a  card  image  was 
delivered  to  a  newly  created  scratch  segment.  Sometime 
later  a  FLEX  statement  might  be  executed: 

new  card  -  format  l  icards ) ; 

Formats  in  FLEX  are  simply  functions  or  user-declared 
unary  operators  which  take  a  string  as  an  argument  and 
deliver  a  string  as  a  reult.  The  card  image  (being  a 
temporary)  is  renamed  as  the  first  parameter  of  format  1 
and  is  thereupon  operated  on. 

Pure  input  devices  are  immediately  supplied  with  a 
new  data  descriptor  input  request.  So  the  "cards"  section 
is  again  set  up  to  receive  a  card. 
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Two-Way  Devices 

These  are  handled  in  a  similar  manner  to  the  printer 
and  punch  except  that  both  read-request  and  write-request 
data  descriptors  are  used.  Also,  it  is  important  to  note 
that,  since  all  I/O  devices  are  just  variables  in  the 
system,  they  may  be  mapped  and  then  selected  on  as  the 
data  enters  or  leaves  the  machine.  Suppose  only  the 
first  five  words  are  needed  from  a  tape  record,  then  the 
following  statement  might  be  appropriate: 

buffer  <-  tape  3  [0  to  4J; 

Only  the  first  five  words  will  be  read  in  and  transferred. 


VI .  Progress  to  Date 
Implementation 


Two  FLEX  compilers  have  been  programmed  in  ALGOL 
on  the  UNIVAC  1108  and  have  been  running  since  mid-February 
1968.  Several  partially  successful  attempts  were  made 
to  combine  the  compilers  with  a  number  of  the  operating 
text  editors  at  the  University  of  Utah.  The  failures 
were  partially  due  to  the  inadequacies  of  ALGOL  as  a 
real-time  and  process  language  in  general,  and  in  parti¬ 
cular,  to  the  very  real  defects  of  the  UNIVAC  version  of 
ALGOL- 60. 

Implementation  of  the  interpreter  has  been  severely 
delayed  for  several  reasons— the  main  one  being  that  it 
took  longer  than  expected  to  work  out  a  rationale  for  a 
segmenting  and  swapping  system  that  would  work  on  such  a 
small  scale. 

Current  implementation  is  now  taking  place  on  an  IBM 
1130  partially  because  the  machine  can  be  dedicated  most 
of  the  time  to  this  task  and  partly  also  because  it  is 
small  and  does  not  tempt  one  into  grandiose  schemes. 
Implementation  on  a  PDP-10  is  also  being  contemplated. 

Future  Expansion 

The  process-oriented  nature  of  FLEX  should  make  it  an 
ideal  kernel  for  numerous  discrete  simulation  schemes. 


99 


A  search  for  primitives  in  this  as  well  as  in  the  semantic 
transformation  area  is  currently  going  on,  and  it  is  expected 
that  some  fruit  will  be  available  for  plucking  in  the  next 
month  on'  this  field  of  discourse. 

Application  packages  are  also  being  studied  with  a 
view  toward  both  allowing  FLEX  to  do  something  useful  and 
providing  a  test-bench  on  which  to  evaluate  the  system. 

To  this  end,  the  solid-state  circuit  design  program  developed 
by  W.R.  Sutherland  on  the  TX-2  computer  at  Lincoln  Labora¬ 
tories  is  being  eye-balled.  FLEX  and  LEAP  (the  implementa¬ 
tion  language  at  Lincoln)  share  some  properties— notably 
the  ability  to  store  and  retrieve  associations— and  it 
will  be  interesting  to  notice  the  difference  between  the 
“ 56k  words  of  fast  memory  on  the  TX-2  versus  4  to  8k 
smaller  words  on  the  FLEX  machine. 
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